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Originality and Importance 


of 


Technical Papers 


eee 


HE SPECTRUM of originality in technical 
writing is extremely broad. It includes the 
revolutionary exposition of a new idea as 
well as the relatively simple extension of a well- 
established theory. 
broad, new concepts are most desired, they are 


Although papers revealing 


rare, and at times their meaning may be obscure, 
their value unobvious. Papers of lesser stature, 
those that are arranged from the sifted wisdom of 
more profound works, are also difficult to evaluate. 
If tutorial, they may serve a useful purpose, but 
when their intent and derivation is not clear, they 
may border on plagiarism, an offense most detri- 
mental to professional standards and a practice 
to be discouraged by all technical publications. 
While the majority of technical papers are not 
of momentous importance, they usually possess 
professional integrity. They extend technical 
knowledge by re-assessing and extending the works 
of others, and many fundamental theories have 
evolved slowly from these small additions to 
knowledge. Frequently, applications and simple 
modifications of existing theories, so obvious after 
they are revealed, are extremely useful in practice. 
The Smith chart and the Nichols chart are exam- 
ples of elementary coordinate transformations 


which add little to the fundamental theory in their 
respective fields, but they do contribute greatly to 
ease of analysis and over-all understanding of the 
theory and its applications. It is clear that the 
importance of a technical paper is not measured 
entirely by its originality nor by its contribution 
to fundamental theory. Indeed, many fundamental 
papers lose their importance because they are 
written tersely by theorists with little time for ex- 
pository detail. Consequently, they may be ig- 
nored until a clearly written tutorial paper inter- 
prets the basic idea of the paper and illustrates its 
usefulness. 

For these reasons, we do not subscribe to the 
frequently received suggestion that technical pa- 
pers should not be published if they could have 
been created easily from established theories, be- 
cause the ease with which an idea could have been 
created cannot be judged after it has been revealed, 
and because all extensions of our knowledge have 
been based on the revelations of others. There- 
fore, it is our intent to publish clearly written pa- 
pers whether of fundamental or tutorial impor- 
tance if it is believed that they will contribute in 
any way to the general theory and basic under- 
standing of automatic control.— The Editor. 
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The Issue in Brief 


Accuracy Requirements of Nonlinear Compensation for Backlash, 
Donald Schulkind 


The detrimental effects of backlash are analyzed with the de- 
scribing function, and both linear and nonlinear compensation are 
devised. The nonlinear compensator effectively matches the recip- 
rocal of the backlash function, thus theoretically eliminating the 
backlash. A noteworthy feature of the paper is that it considers the 
effects of a mismatch between the backlash and its simulated func- 
tion. It is shown that great matching accuracy is not required for a 
significant improvement in performance. 


Specifications of the Linear Feedback Sensitivity Function, William 
A. Mazer 


Although one of the main functions of feedback is to reduce the 
detrimental effects of component variations on system performance, 
this characteristic is seldom analyzed quantitatively as it can be in 
terms of the system sensitivity function. This paper discusses the 
sensitivity function on the basis of minimizing the mean square 
variation of system response. This results in a different performance 
criterion which provides control over the variations of both the char- 
acteristic and forced responses with system parameter changes. 


Synthesis of Linear, Multivariable Feedback Control Systems, Isaac 
M. Horowitz 


A synthesis procedure is developed in this paper to reduce the 
system response sensitivity, to reduce system response to disturb- 
ances, and to realize a set of transmission functions in a multivariable 
controlled process where there are 7 independent inputs and m out- 
puts with 7>1 and m<n. The design procedures are illustrated with 
detailed examples in which there are large plant parameter variations. 


Automatic Control of Vector Quantities, Part IIT, Allen S. Lange 


This is the last article discussing the analysis and design of con- 
trol systems involving vector quantities. The first article! discussed 
space vectors, the second? involved velocity vectors, and this paper 
is largely devoted to forces and moments which produce space ac- 
celerations, important components of which are sometimes neglected 
in simplified analyses. 


1A. S. Lange, “The control of vector quantities, part I,” IRE Trans. on Auto- 
MATIC CONTROL, vol. AC-4, pp. 21-30; May, 1959. 
2 A, S. Lange, “The control of vector quantities, part II,” zbid., vol. AC-5, pp. 
8-57; January, 1960. 


Statistical Evaluation of Digital- Analog Systems for Finite Operating 
Time, R. B. Northrup and G. W. Johnson 


This paper, rather long in its development of a frequency-domain 
mathematical model for comparing the performance of a linear sam- 
pled-data channel to a linear continuous channel, uses many well- 
known techniques to determine an explicit algebraic definition of 
ensemble mean-square error after a finite operating time. This prob- 
lem is important in inertial and Doppler navigation systems, and it 
is hoped that the detailed development, including the illustrative 
examples, will be of use to those interested in this field. 


A Mathematical Representation of Hydraulic Servomechanisms, 
J. J. Rodden 


A detailed, basic representation of a high performance hydraulic 
servo actuator is given in this paper. Simplification and simulation of 
the equations are discussed and the supply accumulator and pump 
are included in the analysis which has been applied in the design of 
missile flight control systems where the rate limit characteristic of 
the actuator is significant. 


A General Method for Deriving the Describing Functions for a Cer- 
tain Class of Nonlinearities, R. Sridhar 


The describing function for two general types of nonlinearities 
are derived and over twenty other describing functions are obtained 
directly from them. The describing functions are classified and the 
defining equations are grouped in a convenient tabular form. 


Soviet Literature on Control Systems, P. L. Simmons and H. A. 
Pappo 


Although this relatively short bibliography cannot be referred 
to as an exhaustive list of Russian control literature, it does cite 
many of the well-known articles published in Russia during recent 
years, it includes many annotations, and it should be of interest to 
those who are not familiar with Russian work in the control field. 


Correspondence 


Interesting properties, characteristics, and classifications of 
adaptive and optimalizing control systems are suggested by Pieter 
Eykhoff, a note on a third-order linear system is presented by Preston 
R. Clement, and in “Improved Transient Response in a Servo System 
with Input Modifications,” B. Chatterjee derives an alternative way 
of synthesizing a “Posicast” control system. 
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Accuracy Requirements of Nonlinear 
Compensation for Backlash* 


DONALD SCHULKIND+ 


Summary—Recent advances in the analysis of nonlinear control 
systems have given rise to a more logical and systematic approach 
to the elimination of the detrimental effects of inherent nonlinearities. 
The describing function technique is used in this paper to analyze 
two typical servos. The servos are shown to exhibit a stable limit 
cycle and are stabilized by linear and nonlinear techniques. The 
nonlinear technique involves the insertion of an additional nonlinear 
feedback element which feeds back a distorted signal opposite in 
phase to the original distorted feedback signal. In particular, a 
method is developed in this paper for determining the accuracy re- 
quired in the construction of a practical nonlinear compensating 
element. 


INTRODUCTION 


ATURATION in amplifiers, backlash in gear 
S trains, and dead space in motors are typical in- 

herent nonlinearities which must be considered in 
the design of any practical servo. Numerous papers have 
been written analyzing the effects of these nonlinear 
elements.':? Once these effects have been analyzed and 
are shown to affect seriously the performance of the 
servo, some means of compensation must be employed. 
The compensation technique used in this paper involves 
the insertion of an additional nonlinear element to com- 
pensate for the existing nonlinear element.’ This paper 
presents a technique for determining the degree of ac- 


curacy required in the construction of the nonlinear 


compensating element for any servo under consideration. 


DISCUSSION 
Development of the Problem 


The block diagram of the first servo under discussion 
is shown in Fig. 1. In order to analyze the effect of the 
nonlinear element whose describing function is NV, the 
frequency-dependent portion is separated from the 
magnitude-dependent portion of the loop (Fig. 2). If 


1+GNVN=0 (1) 


or 


G=—1/N (2) 


* Manuscript received by the PGAC, July 21, 1959; revised 
manuscript received, December 23, 1959. : 

+ Air Armament Div., Sperry Gyroscope Co., Div. of Sperry 
Rand Corp., Great Neck, N. Y. 

1E. C. Johnson, “Sinusoidal analysis of feedback control systems 
containing nonlinear elements,” Trans. ATEE, paper no. 52-154, vol. 
71, pp. 169-181; April, 1952. ; 
_ 2N. B. Nichols, “Backlash in a velocity lag servomechanism,” 
Trans. AIEE, pt. I, paper no. 53-394, vol. 72, pp. 462-467; January, 


1953. seer 
3G. Casserly and J. G. Truxal, “Measurement and stabilization 


of nonlinear feedback systems,” 1956 IRE CONVENTION RECORD, pt. 
4, pp. 52-50. 
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Fig. 1—Typical type-1 positioning servo for an air-to-surface missile. 
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Fig. 2—Modification of Fig. 1. 


is satisfied, then a limit cycle exists. When the curves 
representing G and —1/N intersect, the condition for a 
limit cycle is satisfied. The manner in which these curves 
intersect determines whether or not the limit cycle is a 
stable one. 

The Nyquist diagram for the frequency-dependent 
portion and the amplitude loci of the describing function 
for backlash (zero per cent) are shown in Fig. 3. The 
dotted curves and shaded area of Fig. 3 are explained in 
the section on nonlinear compensation of this loop. The 
frequency and magnitude of the limit cycle are deter- 
mined in the following manner. From Fig. 3, the inter- 
section of the frequency-dependent portion and the 
amplitude loci of the describing function (zero per cent) 
for backlash occurs at w=6 rad/second and | - 1/| N| | 
=8.0 or | N| =0.125. When | N| is equal to 0.125, then 
A/a=1.09 (see Appendix I) and the following equation 
results: 


Sose = (A)(N) (G2) (2) 
= (4)(| |) sits Q) | 
sft * ZKOAS)S Si | | 
(150) (150)? S=j6 
= 0.177(a) (peak-to-peak) (3) 


where a is the width of the backlash, A is the magnitude 
of the sinusoidal input to the nonlinear element, and 


Wose = 6 rad/second. (4) 
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Fig. 3—Nyquist diagram for Fig. 2 with amplitude loci for nonlinear-compensated backlash. 
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Fig. 4—Servo No. 2. 
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Fig. 5—Nyquist diagram for Fig. 4 with amplitude loci for nonlinear-compensated backlash. 
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Fig. 6—High-speed analog computer results. 


The block diagram of the second servo under discus- 
sion is shown in Fig. 4. The loop is analyzed in a manner 
similar to that for the first loop. The results are shown in 
Fig. 5. The frequency and magnitude of oscillation are: 


12 rad/second (5) 


Wose — 
dose = 0.402a (peak-to-peak). (6) 


The basic difference between the two loops is that the 
frequency-dependent portion of the loops as seen from 
the nonlinear element contains a pure 1/s in the first 
servo and a pure 1/s? in the second servo. An analog 
computer study was performed with the results pre- 
sented in Figs. 6 and 7.4 A comparison of the results ob- 
tained from the analog computer study and theoretical 
computations shows that both agree favorably with the 
magnitude and frequency of oscillation noted on the 
physical equipment. 


Elimination of the Limit Cycles 
A study of the Nyquist diagram of Fig. 3 shows that 
4 It should be noted that backlash is given in terms of milliam- 
peres (valve current) since the nonlinearity occurs between the input 


current to the torque motor which positions the hydraulic valve and 
the positioning of the hydraulic valve. 


10 20 30 40 50 
WIDTH OF BACKLASH-MA 


Fig. 7—Comparison of theoretical and computer results. 


additional phase lag introduced by the amplifier at low 
frequencies is sufficiently great to cause an intersection 
with the amplitude loci for backlash. If a lead-lag net- 
work® is inserted in the loop so that the over-all phase 
lag occurs at higher frequencies, no intersection occurs 
(Fig. 8). This technique was employed on the physical 
equipment with the results shown in Fig. 9. 

If a nonlinear device having a describing function 
N’ and a frequency-dependent portion G’ is inserted into 
the loop, as shown in Fig. 10, the basic condition for a 
limit cycle is: 


1 + NGG2G3 + N'G,G’ = 0. (7) 
For 
0.386 
G’ = G2G3 cS 
O15) Se) 82 
Sue + | 
150 (150)? 


(perfect linear element), (7) may be written 


190(1 + 0.09335 
= GiG.G3 = | ( ‘| 


1 + 0.2665 


3.86 
e 4 2(0:15)S S? 
150 (150)2 


(0.1) (8) 


5 A lead-lag network has a transfer function of the form 


where J) > 7». 
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Fig. 9—Response of servo no. 1. 


where the right-hand side is the Nyquist diagram of Fig. 
3. The dashed curves of Fig. 3 represent a variation in 
NN’ where N’=x(1—J) as x varies from 0 to 1.0 (0 per 
cent to 100 per cent). The figure 100 per cent represents 
perfect conpensation. It is seen from Fig. 3 that only 5 
per cent or more nonlinear compensation is required for 
this servo to eliminate the limit cycle. A circuit develop- 
ing a good approximation to 1—J is shown in Fig. 11. 
A discussion of the operation of this circuit is presented 
in Appendix II. For N’=1—W (perfect nonlinear ele- 
ment), (7) may be written 


—1 GiG2G3 — G.G’ 
= —. (9) 
N aie 


The shaded area of Fig. 3 represents a variation in the 
linear element G’ where G’= K/(S+a) as K varies from 
0.193 to 0.772 and @ varies from 0.193 to 0.772. It is seen 


Fig. 10—Servo no. 1 with nonlinear compensation. 


Fig. 11—Network simulation for 1— N where N is 
the describing function for backlash. 


from Fig. 3 that the elimination of the limit cycle is very 
insensitive to variations in the linear portion of the com- — 
pensating device. The nonlinear element of Fig. 11 and 
a linear element G’=0.386/(S+0.386) were incorpo- 
rated into the physical equipment with the results shown 
in Fig. 12. An analog computer study was performed em- 
ploying nonlinear compensation with the results shown 
in Fig. 13: 

An examination of the Nyquist diagram for the 
second servo shows that pure differentiation is the only 
form of linear compensation that could eliminate the 
limit cycle, since the frequency-dependent portion 
of the loop has a high gain and —180° phase shift at 
low frequencies and must approach zero gain at high 
frequencies. However, if pure differentiation is used, the 
positional accuracy of the servo is seriously affected. 
Therefore, only nonlinear compensation is considered 
for this servo. 
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Fig. 12—Step response of servo no. 1. 
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Fig. 13—High-speed analog computer results—servo no. 1. 


If a nonlinear compensation device is incorporated 
into the second servo as shown in Fig. 14, then the basic 
condition for a limit cycle is 


1+ NGiG.|Gs + GiGs] + N’GiG;sG’ = 0. (10) 


Variations in NV’ and G’ are treated in a manner similar 
to that of the first servo. The shaded area of Fig. 5 
represents a variation in the linear element G’ where 
G’ =K(s+a)/(s+8) as K varies from 0.225 to 0.898, 
qa varies from 1.72 to 6.88, and 6 varies from 0.05 to 
0.10. Nonlinear compensation of 15 per cent or more is 
required to eliminate the limit cycle. The network of Fig. 
11 and a linear element G’=0.45(s+3.44) /(s+0.075) 
were incorporated into the system with the results 
shown in Fig. 15. An analog computer study was per- 
formed in order to show the effect of this nonlinear com- 
pensation network. The results are shown in Fig. 16. 


Fig. 14—Servo no. 2 with nonlinear compensation. 
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Fig. 15—Step response of servo no. 2. 
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Fig 16—High-speed analog computer results—servo no. 2. 


84 [IRE TRANSACTIONS 


Fig. 17—Describing function for backlash. 


CONCLUSION 


The design of nonlinear compensation to eliminate 
oscillations caused by an inherent nonlinearity in a 
servo can be performed without too much difficulty by 
the use of the describing function technique. However, 
inherent errors exist in the use of the describing function 
technique due to the basic assumptions of the technique, 
which are: 


1) Only the fundamental component of the Fourier 
series expansion of the output of the nonlinearity 
for a sinusoidal input is important since attenua- 
tion is present in the loop for harmonics of the 
fundamental frequency. 

2) Only one nonlinearity exists in the system. 


Nonlinear compensations of only 5 per cent and 15 per 
cent are required in the two servos analyzed in this 
paper. Because of the inaccuracy of the describing func- 
tion technique and the variation of component nominal 
values over environmental conditions, a figure of 20 
per cent is more desirable in order to insure stability. 


APPENDIX | 


The describing function for backlash has been derived 
in several papers, with the following results (Fig. 17) : 
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Fig. 18—Describing function for nonlinear-compensated backlash. 


where 


u=1-2a/A 
Ox, == Al Siam te 


2a=width of backlash. 


When a nonlinear compensating element is inserted into 
a loop so that its input is the same as the existing non- 
linear element, and when the frequency-dependent por- 
tion of the compensating element is similar to the exist- 
ing frequency-dependent portion of the loop, then the 
effective nonlinear feedback element is V+ NV’, where NV 
is the describing function for the existing nonlinear ele- 
ment and N’ is the describing function for the compen- 
sating element. For N’=x(1—WJN), the effective non- 
linear feedback becomes x+(1—x)N where x varies 
from 0 to 1.0 or 0 per cent to 100 per cent. Fig. 18 isa 
plot of V+ N’ as x varies from zero per cent (no com- 
pensation) to 100 per cent (perfect compensation). 


| 


| | 


u? — 1 


Larry oT 2 Ey ieee er) 
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6H. D. Greif, “Describing function method of servomechanism 
analysis applied to most commonly encountered nonlinearities,” 
Trans. AIEE, pt. I, vol. 72, pp. 243-248; September, 1953. 


1960 


APPENDIX II 


The operation of the circuit of Fig. 11 to a sinusoidal 
input is the following: Initially the capacitor voltage 
remains zero until one of the diodes begins to conduct. 
At this time the capacitor voltage increases until the 
difference between the input and capacitor voltages be- 
comes less than the voltage required to maintain diode 
conduction. The capacitor voltage will then remain con- 
stant until the difference between the input and ca- 
pacitor voltages becomes greater than the voltage re- 
quired to cause diode conduction. At this time, the 
operation cycle begins again with the other diode (see 
Fig. 19). The capacitor voltage response to a sinusoidal 
input is identical to the output response of a device 
having backlash. 
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in 


Fig. 19—Response of capacitor voltage of Fig. 11 
for a sinusoidal input. 


Specification of the Linear Feedback 
System Sensitivity Function’ 


WILLIAM M. MAZERT 


Summary—tThis paper examines the problem of designing a 
linear feedback system so that its response to a specified input is 
relatively insensitive to slow changes in system parameters. Classical 
feedback design techniques involve the specification of the system 
sensitivity function on the basis only of the forced response to a 
given input. A new performance criterion has been derived, in which 
the mean square variation of the system response is minimized. This 
specification of the sensitivity function results in control over the 
variation of both the characteristic and forced responses with system 
changes. The approach is based upon the assumption of a differ- 
ential change in the variable system parameter, but yields workable 
results for large changes. It employs mathematical techniques which 
have been well developed for other applications in network design. 
The stability problem associated with high loop gains is considerably 
reduced when the sensitivity function is specified on the basis of this 
criterion. , 


* Manuscript received by the PGAC, September 28, 1959; revised 
manuscript received, January 15, 1960. This paper is based on a dis- 
sertation submitted in partial fulfillment of requirements for the 
D.E.E. degree at the Polytechnic Institute of Brooklyn, Brooklyn, 
N. Y. The work described was done at the Microwave Research In- 
stitute of the Polytechnic Institute of Brooklyn, under Contract 
DA-30-069-ORD-1560 of the Office of Ordnance Research, and at the 
New York Systems Laboratory, Surface Communications Division, 
Defense Electronic Products. a 

+ Defense Electronic Products, Radio Corp. of America, New 
York, N. Y. : : 


INTRODUCTION 


HIS SECTION is a summary of previous work in 
Pit area of feedback sensitivity. 

The network designer synthesizes system struc- 
tures which must respond in a specified manner despite 
changes in component behavior. Practically, the 
achievement of a desired response characteristic and 
its relative insensitivity to system parameter changes 
are both basic requirements of a successful design. In 
many cases, the invariability of the response is even 
more important than its nominal behavior. Analysis and 
synthesis procedures must take account of these re- 
quirements, with the precision afforded by available 
mathematical techniques. 

Although purely passive, linear circuit elements very 
often satisfy a specified dynamic response requirement; 
the use of active elements in conjunction with feedback 
offers the possibility of extreme stability of this response 
characteristic. Furthermore, the necessity for perform- 
ing energy conversions often makes the use of active ele- 
ments mandatory. The diversity of reasons for using 
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feedback!= may be summed up into two general areas, 
1.e., Convenience, and insensitivity of the system re- 
sponse. For example, reduction of the source impedance 
of a network by means of feedback may be regarded as 
a minimization of the sensitivity of the response char- 
acteristic to changes in the load impedance, which is 
viewed as part of the feedback system structure. Feed- 
back may also be used to force an active element, or 
controller, to have a response considerably different 
from its open loop response. Convenience and response 
insensitivity, or “self-calibration,” are simultaneously 
achieved by means of feedback when the characteristics 
of the control devices are known only as a statistical 
distribution, or within a specified tolerance envelope. 

A quantitative definition of feedback sensitivity is 
required in order to enable precise system synthesis and 
analysis procedures to be established. The ultimate in- 
terest in time domain behavior makes the definition of 
a time domain sensitivity function appear to be desir- 
able. However, analytic difficulties, as well as problems 
in formulating suitable specifications for such a func- 
tion, make the use of the inverse of the complex fre- 
quency domain function, defined by Bode,? a more 
feasible approach. Although a considerable literature 
exists,>* relating this sensitivity function to the ele- 
ments of a feedback structure under steady-state sinus- 
oidal excitation, all the advantages of the complex 
function theory are available to the designer, and sys- 
tem inputs of a more general nature may be considered. 

Consider the linear, lumped parameter feedback 
structure shown in Fig. 1. The premultiplying transfer 


Fig. 1—Basic feedback system. 


function A(s) and the function B(s) in the forward path 
are assumed to be compensating networks whose pa- 
rameters are invariant. The transfer function M(s) may 
be written 


(S21) (94 22) ++» 


M(s) =k 
(OPS RIO eae a a 


(1) 


1 J. G. Truxal, “Automatic Feedback Control System Synthesis,” 
McGraw-Hill Book Co., Inc., New York, N. Y., p. 113; 1955. 

2 E. J. Angelo, “Design of Feedback Systems,” Microwave Res. 
Inst., Polytechnic Inst. of Brooklyn, Brooklyn, N. Y., Res. Rept. 
No. R-449-55, PIB-379. 

*H. W. Bode, “Network Analysis and Feedback Amplifier De- 
sign,” D. Van Nostrand Co., Inc., New York, N. Y.; 1945. 

4S. Barabaschi and E. Gatti, “Modern methods of analysis of 
electrical linear active networks with particular regard to feedback 
systems,” Energia Nucleare, vol. 2, pp. 104-119, December, 1954; 
vol. 2, pp. 168-197; February, 1955. 
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M(s) is an active element, such as a controller or 
amplifier. The quantities Z; and P; are zeros and poles, 
respectively, of M(s), and & is its gain. These elements 
are considered variables, with respect to which the sys- 
tem response is to be stabilized; they are assumed to 
change slowly compared to the system response time. 
The closed loop transmission function is given by 


C(s) A(s) B(s)M(s) 


Lig = 
RG) ss) es) 


(2) 


C(s) and R(s) are the transforms of the system output 
and input, respectively. With respect to a variable ele- 
ment x of M(s), the sensitivity of 7(s) is defined as? 


e7/4 
S2(s) = x  aT{s) fe dined (s} + 3) 
he T(s) dx din«x = ex/y 


Thus the changes in 7(s) and x have been normalized 
with respect to their nominal values. By suitable trans- 
formations, the premultiplying transfer function may be 
eliminated, and a feedback structure with a compensa- 
tion network in the feedback path achieved. Alterna- 
tively, the forward path compensating network inside 
the loop may be eliminated. The results obtained here 
will be applicable to such structures as well. Differenti- 
ating (2), and inserting the result into (3), one obtains 


ay aM (s)/dx 


Lei i aaeare 


S2"(s) 


1 
1 2BeMeOn 


Roy 


d\n M(s) 
3 dilnx 


For x=k, Z;, or P;, (4) becomes 


ssi) eee ee 
1+ B(s)M(s) 
Ve 15 
ners ea i Z; 1+ Bis)M(s) / © 
=F 1 
AEG R eete 


s+ P; 1+ B(s)M(s) a 


The results given by (5)—(7) may be obtained in an 
Iternate manner. In accordance with Bode’s theorem, 
whereby any transmission 7(s) may be written as a 
bilinear transformation of the parameter x, the diagram 
of Fig. 1 is redrawn into the forms given in Fig. 2. The 
variable element appears only in the forward path with- 
in the feedback loop in each case. Fig. 2(d) illustrates 


The inverse of Bode’s sensitivity function. 
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A(s) aval 
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Mis) 
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s +B(s)[Ms)(s+Pj)] 


A(s)B(s)[M(s)(s+P,)] 
(5+8(s) [Mis\(s + Pil] )* 


R(s) 


——— C(s) 


A(s) B(s) [M(s)(s+P))] 
s +B(s)[M(s)(s+ Pj)] 


(c) 


t, 


R(s) C(s) 


(d) 


Fig. 2—Alternate system configurations. 


the notation used by Truxal,® for the parameter x. Using 
this notation, 
Xt into 


— Xt)” 


-| =| 
| fe | 
F, fe 


Here F, is the return difference with respect to the 
parameter x. The functional dependence on s has been 
omitted. The results given by (5)—(7) may be obtained 
directly using (8). 


(8) 


6 Truxal, op. cit., p. 120 ff. 
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The return difference for the zero transmission leak- 
age case, where R is the variable parameter, is a common 
factor among these sensitivity functions. This results in 
a definite relationship among the system response vari- 
ations, due to each variable parameter. 

The sensitivity with respect to k approaches unity as 
Ss approaches infinity. This may be ascertained from 
(5), where it is evident that B(s) M(s) approaches zero 
at high frequencies, if this product corresponds to a 
physical structure. The system operates open loop at 
high frequencies, so that the relative variation of 7(s) 
is identical with that of k. Thus S.?(s) has an equal 
number of finite poles and zeros. The sensitivities with 
respect to Z; and P; have an added finite pole. 

Although the sensitivity function has been defined 
and several of its properties examined for the particular 
system model under consideration, it is not yet apparent 
how one may utilize it in system design, or more funda- 
mentally, on what basis its characteristics should be 
chosen. The following sections consider various bases for 
the specification of the sensitivity function. 


SPECIFICATION OF THE SENSITIVITY FUNCTION 


A common design approach consists of making the 
“loop gain,” or return difference, extremely large in the 
band of frequencies in which the input signals are ex- 
pected to lie. Then the open loop response is caused, by 
appropriate shaping, to fall off as rapidly as possible to 
unity gain outside this band. A maximum roll-off rate 
of about 33 db per decade permits unconditional sta- 
bility to be achieved, while a greater rate results in con- 
ditional stability. Thus realization of low reponse sensi- 
tivity by making the magnitude of the sensitivity func- 
tion small in the desired band of frequencies inevitably 
results in the problem of system stability. Yet this tech- 
nique often yields a considerably overdesigned system, 
particularly when the input signal is known to be a re- 
stricted type, such as a succession of steps or decaying 
exponentials. Although it is usually desirable to restrict 
the variability of the transient, as well as the steady- 
state response, with changes in system parameters, this 
approach is analytically sound only for variations of the 
forced response to sinusoidal excitations. 

On the other hand, a synthesis procedure is available 
in which the problems of system stability and sensitivity 
are theoretically divorced.’-® Essentially, it can be 
shown that the inclusion of two compensation networks 
in a conditionally stable feedback system enables the 
separate specification of the system transmission and 


7C, Lang and J. M. Ham, “Conditional feedback systems—a 
new approach to See control,” Trans. AIEE, pt. II, vol. 74, pp. 
152-161; July, 195 
BSl* ee Truxal, “Modern network theory and its application to 
feedback control, ” Proc. Conf. on Systems Engrg., Purdue University, 
Lafayette, Ind., pp. 79- 104; July, 1955. 
Dee I 1D). Reeves, “Feedback amplifier design,” Proc. IEE, pt. 
IV, vol. 99, pp. 383-389; October, 1952. 
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sensitivity functions. To design a system, such as shown 
in Fig. 1, to meet only a prescribed transmission func- 
tion requirement, any number of combinations of A (s) 
and B(s) may be employed. However, if a specified sen- 
sitivity function is to be achieved as well, then A(s) and 
B(s) are uniquely defined. Additional problems are 
usually encountered in the physical realization of the 
desired compensation networks. However, suitable ap- 
proximation procedures may be employed to yield work- 
able results, although the desired transmission and 
sensitivity functions will not be realized exactly. 

The possibility of achieving low system sensitivity 
with small values of loop gain has been discussed in the 
literature,!°" although the inputs dealt with were 
steady-state sinusoids. The basic problem is the deter- 
mination of criteria for the specification of the sensitiv- 
ity function for an arbitrary input. After the form of the 
desired transmission function has been ascertained, 
based on some dynamic response criterion, (5)—(7) re- 
veal that the system parameters which remain to be 
specified are the zeros of the sensitivity function. The 
poles of the sensitivity and transmission functions are 
identical, except for the added poles of Z; and P;, pro- 
vided the product A(s) B(s) M(s) in (2) is chosen so that 
no poles are added to those of the reciprocal of F;(s). 

Based upon this approach to the feedback system 
synthesis problem, an entirely new procedure for speci- 
fying the sensitivity function may be formulated for an 
arbitrary input. In the following section, results previ- 
ously achieved in this area are discussed. In the succeed- 
ing sections, the major contributions of this paper are 
presented. 


THE FORCED RESPONSE CRITERION 


Suppose the desired response in the time domain is 
given by c(¢), and the response error by e(¢). Then the 
zeros of S(s) must be determined so that e(¢) behaves 
in a desired manner over the interval or intervals of 
interest in the time domain. A considerable literature 
exists whereby one may relate time domain responses 
to the complex frequency domain characteristics of a 
given network configuration.”—4 These results are useful 
when the inputs are restricted types, and when the sys- 
tem poles are simple. Functions of third or higher order, 
with multiple poles, and possible poles on the jw axis, 


10H. S. Black, “Stabilized feedback amplifiers,” Bell. Sys. Tech. 
J., vol. 13, pp. 1-18; January, 1934. 

uD. L. H. Gibbings and A. M. Thompson, “Gain stability of 
Les amplifiers,” Proc. IEE, pt. III, vol. 101, pp. 35-37; January, 
1954. 

2 J. H. Mulligan, Jr., “The effect of pole and zero locations on 
the transient response of linear dynamic systems,” Proc. IRE, vol. 
37, pp. 516-529; May, 1949. 

18 W. H. Kautz, “Transient synthesis in the time domain,” IRE 
TRANS. ON Circuit THEORY, vol. CT-1, pp. 29-39; September, 1954. 

4 JT. Gumowski, “Some relations between frequency and time 
domain errors in network synthesis problems,” IRE TRans. ON 
Circuit THEORY, vol, CT-5, pp. 66-69; March, 1958. 
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are difficult to deal with. Since the steady-state error 
may be determined without actually calculating c(t), 
this approach would be of interest in controlling e(¢) 
over the part of the time response during which the 
transient is still appreciable. The computational dif- 
ficulties inherent in establishing a quantitative relation- 
ship between time response and the complex frequency 
characteristics of the sensitivity function preclude such 
a procedure as a general design technique. 

If the sensitivity function is to be specified only on 
the basis of the forced response toa given input, then the 
zeros of S(s) are chosen as follows. If R(s) consists of a 
number of inputs of the form 


1 
R,(s) a) ree o (9) 
Si + Sk 


then the system output is given by 


1 
Cx(s) =a TKS); 


(10) 
§ 4p Se 
and the forced response is 
cy(t) =~a,T (— Sy) e~%*". (11) 


Taking the derivative of c,(t) with respect to a variable 
parameter x, and substituting (3): 


dc, (t ak 
tp eae T(— Sx) S27 (— Sx) e7!. 
dx x 


(12) 


Thus, if the sensitivity function has a zero at the pole 
of the transform of the input function, the system 
forced response is invariant with changes in x. A number 
of zeros equal to the system order is available for selec- 
tion on this basis. If the s, are expected to lie in some 
known range of values, the sensitivity zeros may be dis- 
tributed accordingly. This result is valid when s; is 
imaginary, but in that case both the steady-state ampli- 
tude and phase responses are of interest. For a sinus- 
oidal input, the forced response and its derivative with 
respect to x become: 


c(t) = ma T(js)| sin [r+ $(is)) (13) 
where 
$(js,) = a 
se oJ sin (ot +4) JEMEZ) ae 
es a ene ot . (14) 
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T(js,) = | TCjs.) | e*, (15) 
then 
paved| Tle | 
T( 7 — 
De (js) | T | eid an 
Bem Dhl. dd 
‘ a dx ee 
= Sri 957) 1 9or( sr) (16) 


The & and I subscripts in the last equation refer to the 
real and imaginary parts of S(js,), respectively. Thus, 
if zeros of S(s) are assigned at +js,, then both the forced 
amplitude and phase responses are invariant with 
changes in x, as seen in (14). However, if these zeros are 
assigned only to the even or odd parts of S(s), then only 
the amplitude or phase response, respectively, will be 
invariant wlth changes in x, although S(s) itself will 
have no zeros at +7s,. In general the zeros of S(s) will 
then be complex, which should simplify the approxima- 
tion problem. 

This section has demonstrated how variations in the 
forced response may be controlled by suitably specifying 
the sensitivity function. The lack of control over varia- 
tions in the transient response is conspicuous. This 
paper adds to prior work by developing a relation- 
ship between the variability of the complete response, 
including the transient, and the sensitivity function. 
The remaining part of the paper develops these ideas in 
the form of a suggested design procedure. 


THE MINIMUM MEAN SQUARE ERROR CRITERION 


A design based only upon the forced response is likely 
to result in an unsuitable selection of the zeros of the 
sensitivity function, if the system is of high order, and 
the input is of a known, invariant form. For example, 
if a fifth-order system is to be subjected to a sinusoidal 
input, then five sensitivity zeros must be assigned. Two 
zeros are given values corresponding to the poles of the 
input transform; there is no reasonable basis for select- 
ing the remaining three. Furthermore, if interest is 
centered upon the part of the system response where the 
transient has an appreciable value, then even the forced 
response criteria outlined have little value in determin- 

ing suitable sensitivity zeros. 

The design approach based upon root locus techniques 
results in the choice of a network configuration with 
poles and zeros which move in such a way, with a given 
system parameter change, that the basic character of 
the transient response remains unchanged. A different 
point of view may be taken in employing a curve match- 
ing technique, with the specification of the sensitivity 
zeros as the end product of the procedure. One common 
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curve matching technique minimizes the mean square 
difference between a desired and an actual response. A 
straightforward mathematical technique has already 
been developed for the synthesis of feedback systems, 
and for the design of filters with noisy inputs, based 
upon a minimum mean square error criterion. This 
technique is directly applicable to the sensitivity prob- 
lem; its chief advantage is that the problem is solved 
entirely in the complex frequency domain. Thus the 
necessity for obtaining the error in the time responses 
of high-order feedback systems, in terms of the un- 
known zeros of the sensitivity function, is avoided. Be- 
fore proceeding with a detailed exposition of this 
method, the following definitions are required: 


= N(s) 
T(s) = D(s)’ 
cs No(s) 
S(s) = Do’ 
Ax 
AT(s) = — T(s)S(s), 
x 


E(s) = R(s)AT(s). (17) 


The A notation is used to indicate a small finite, rather 

than differential, change. The mean square error is 

given by 

iE 
e?(t)dt. (18) 


ae ae i 
e? = lim — 
sey DIT 7 
Here e(¢) is the inverse transform of E(s). The square 
of the error is integrated over a time interval of length 
27, its average is taken, and the time interval is then 
allowed to become infinite. By a simple mathematical 
exercise it may be shown that 
= ike 
e? = -— AT(s)AT(—s)®,(s)ds. 
21} J —je0 


(19) 


®,(s) is the power density spectrum of the input signal. 
Substituting (17) into (19), 


es 1 ies (= ) 
e2 = ——— aaae 
2nj Jeo x 


No(s)No(—s) 


PODER. ei wee 


(20) 


To minimize the mean square error e? one takes its 
partial derivatives with respect to each unknown co- 
efficient of No(s), and sets the results equal to zero. This 
yields a number of linear algebraic equations equal to 
the number of unknown coefficients. Furthermore, if 
N,(s) is of even (odd) degree, all coefficients of odd 
(even) powers of s must equal zero. 


1 Truxal, op. cit., footnote 1, p. 411 ff. 
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In order to obtain a suitable power density spectrum 
for use in (20), aperiodic inputs such as step and ramp 
functions, with which the feedback system designer is 
accustomed to deal, must be modified by being repeated 
periodically. Although the system is then designed on 
the basis of this fictitious input, it may be shown that 
the results obtained are of considerable value when the 
input is aperiodic. Furthermore, the periodicity of the 
repeated input signal determines approximately the 
interval of time over which the mean square error, for 
the case of an aperiodic input, is minimized. The system 
may also be optimized with respect to stationary 
random inputs. 

Another possible approach is the use of an integrated 
square instead of a mean square error minimization cri- 
terion. This appears to offer the advantage that the true 
aperiodic input is used in the synthesis. This procedure 
would involve expressing the time domain response 
variation in terms of the unknown zeros of the sensi- 
tivity function. This results in an unwieldy and compli- 
cated design procedure. The advantages of working en- 
tirely in the complex frequency domain are lost. At 
least one exception occurs with the use of a weighting 
function, such as a decaying exponential function, 
which results in a straightforward synthesis procedure 
involving only the evaluation of residues. 

The step-by-step solution of a typical problem will 
clarify the minimum e? design procedure described 
above. 


DESIGN EXAMPLE 


Design a feedback system in the configuration of Fig. 
1, with the following closed loop transfer function: 


5 
(etn Ge 5). 


IBS (21) 


Since the system is of the third order, No(s) may im- 
mediately be written 


No(s) = s? + aos? + ays + ao. (22) 


If the variable element is the forward gain k, the mean 
square error becomes 


ik i / Ak \? T(s)T(—S) 
Inj J je es) D(s) D(—s) 
-[(aos? + ao)? — 52(s? + a1)?]&,(s)ds. 


= 


(23) 


Since e? is the sum of two integrals, one may solve for a» 
and do separately. Taking partial derivatives with re- 
spect te these quantities, 
de? Lint ei T(s)T(—s) 
0a. Ari J _jn \ k / D(s)D(—s) 


-2(d25” + do)s°®,(s)ds = 0 - (24) 
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1 ae 2G) Ps) 
Qj J ice a beares: 


-2(aos? + ao) ®,(s)ds = 0. (25) 


Solving (24) and (25) for a, and dp, an homogeneous set 
of equations results, the solutions of which are @3 =a) =0. 
To solve for a1, 


Je? 1 i= é ) T(s)T(—s) 


Ai. a eee Oreo Dee 
- [—25?(s? + a1) ]@,(s)ds = 0 (26) 
1 i T(s)T(—s) F : 
sod. pope OO DRO 
a= (27) 
‘h © T(s)T(—s) 
(s)(—s)®,(s)ds 


2nj J je D(s) D(—s) 


Thus a; is independent of Ak, provided the latter is 
small enough for the first-order approximation A7‘(s) 
given by (17) to be reasonably valid. Furthermore, 
®,(s) being positive, a; is always positive, and the inte- 
grands are written as conjugate products in (27) to 
emphasize this fact. 

The character of the input remains to be specified, 
so that ®,(s) may be evaluated. Suppose the input is a 
sinusoid of frequency B=4 rad/second, and that the 
mean square error in the system response, over one 
cycle of the driving function, is to be minimized for 
small changes in k. To generate an appropriate repeti- 
tive input signal, let the input sinusoid be multiplied by 
a square wave of frequency w» =} rad/second, and unity 
height. The wave depicted in Fig. 3 results. The desired 
output over 7/2 = 12.56 seconds is shown in Fig. 4. The 
Fourier series and power spectrum of the square wave 
are 


Peq(t) 


+—[s( = +3( ge (29 
75 baked arg lare 2) 
Here 6(w +a») is the Dirac delta function. If this square 
wave is driven through a fictitious transfer function, 


Ss § 
F(s) = 2 cc Se 1)2 
Saat 8 eG) 


(30) 
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Fig. 3—Input function. 
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Fig. 4—Plot of co(t) vs time. Response of 
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to a sinusoid with transform 


T o(s) = 


1 
s? + (1/2)? 


then the wave shown in Fig. 3 results. The power spec- 
trum of the input is thus given by 


,(w) = B,q(w) | F(je) |? 


[2 — OP 


with ®,,(w) given in (29). The integrals of (27) are 
evaluated by penne twice the values of the inte- 
‘grands at w=}, 3, 3, etc., since they are even functions 
and thus always positive. The summations are con- 
tinued until the desired accuracy is achieved, The values 
of the integrands fall rapidly with increasing w, since 
the degrees of the denominators are much larger than 
those of the numerators. Se T(s), D(s), and 
®,(s), one obtains 


B,4(w) (3 1) 


Feedback | 


System Sensitivity Function 9] 
: i Is s)T(—3) (s)3( sp = 1 
Hal aout ae 
=()- 701 (102322) 
1 i T(s)T(—s) d ; 
ell eines re 
=1.238(10-7) (32b) 
1 oes S )L (5) 
= = »(s)a 
sdb aaa DO 
== 2511 1OR) auG2e) 
Then by (27), 
a, = 0.494, (33) 


This value of a; is accurate to 0.2 per cent using only 
the first five terms in the Fourier series of (29). Now 
the mean square error is 


= 1 yo ( Ak , T(s)T(—s) 
pss 
25) J —i5 \ ko) (5) Dis) 
-(— 5?) (s? + a)?,(s)ds. (34) 
Substituting (32) and (33) into (34), 
& Ak \? 
2 = 0.00149 (=) : (35) 
The sensitivity function is 
s(s? + 0.494 
Sk?(s) = (36) 


(eee tae ee se 


A comparison with the forced response criteria, in 
terms of relative values of e? and other factors, is useful 
to assess the merit of this approach. 


COMPARISON OF DESIGNS 


To insure zero variation of both the steady-state 
amplitude and phase responses, one would have set 
a,=6? =}. For this value of ai, e? becomes 


Die Ns 
0.00269 (=) : 


The minimum e? design thus reduces this mean square 
error by a factor of 1.8. A design in which only the even 
part of S(s) is assigned the zeros of s= +7} yields only 
steady-state amplitude response invariability. In this 
case, let 


(37) 


e? 


—s*[52 + (1/2)?]? 
‘4 =m - (38 
OT rerersinaye ma Seen Ea to 
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Now since 


Sr(s) = 1/2|S(s) + S(=s)], (39) 


therefore 

s(s? + 1.0675 + 0.899) 
(@+st 1(o+5) 

Substituting (40) into (20), 


i Ak 
e? = 0.0197 (=) : 
k 


Comparing (41) with (35), the mean square error is re- 
duced by a factor of 13. 

The results achieved in this example of a third-order 
system indicate that the zeros of No(s) occur at s=0, 
and on the jw axis in conjugate pairs. This may be 
shown to be true regardless of system order. To examine 


the influence on e? of a nonzero coefficient of s, say 6, 
let No(s) be given by 


No(s) = s(s? + 6s + 0.494). 


No = 


(40) 


(41) 


(42) 
Then 


No(s)No(—s) = — s?[(s? + 0.494)? — 6%s?]. (43) 


The first factor within the bracket results in the minimum 
e given by (35). The e? corresponding to the second 
factor has been evaluated in (32b). Thus the new e? is 


ES Ak \? 
e? = [0.00149 + 0.01248"|( —) (44) 


The value of 6 which causes e?, given by (44), to be 
double that of (35) is given by 


0.001499 1? 
p= || = 0538. 


45 
0.0124 S) 


This results in a very severe requirement on the R/L 
ratio of the system compensation circuitry. However, 
the transmission function in the design example has an 
undamped natural frequency at w,=1 rad/second, and 
6 is normalized with respect to this quantity. When 
®,=100, 6=35, which is a considerably relaxed circuit 
R/L requirement. Thus the practical application of the 
minimum @é design appears to be limited to systems of 
considerable bandwidth. 

Although all calculations required to obtain No(s) 
have been performed in the complex frequency domain, 
it is instructive to check the results obtained by addi- 
tional calculations in the time domain. Ordinarily these 
are not a necessary part of the design procedure. For 
example, it would be of interest to determine the effect 
on the transient response of a finite change in k, since 
an infinitesimal change was assumed throughout the 
calculations. Furthermore, since the system was de- 
signed for the input given by Fig. 3, the transient re- 
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sponse and the mean square error resulting from a sud- 
denly applied sine wave with no phase reversals, should 
be examined. The time domain response errors, for sys- 
tems designed on the basis of different criteria, should 
be compared. 

The first step in performing exact error response cal- 
culations involves solving for A(s) and B(s) in Fig. 1, in 
terms of the specified nominal transmission and sensi- 
tivity functions, when k has some nominal value k= Ro. 
Thus the compensation networks will contain models 
of these nominal functions. Substituting these values of 
A(s) and B(s) into (4), the transmission for any value 
of k becomes 


TG) = T)(s). (46) 


1 [= -1]se9 
ahr Js 


Here 7)(s) is the value of the transmission when k=Ro, 
1.e., the desired transmission function. Substituting for 
To(s) the value given in (21) and for S(s), (36) and (40), 
and letting k/ky =0.8, T(s) becomes 


iS) a— - : (47a) 
(s + 3.785) (s? + 1.01555 + 1.057) 
4 
Tr(s) = (47b) 


(s + 4.023) (s? + 0.99045 + 0.9954) 


The subscript e refers to the design based upon the 
minimum e? criterion; the subscript R refers to the de- 
sign in which the real part of S(s) is specified. The re- 
sponses of these transmission functions, and that given 
by (21), to suddenly applied sinusoids of amplitude = 2, 
and angular frequency @=3%, are plotted in Figs. 4 
through 7. The squared error responses have been 
averaged over 12.56 seconds. From (35), the minimum 
e? for the phase-reversed sinusoidal input is 


- Ak \? 
émin = 0.00149 (=) = 9.31(10-). (48) 


The value of e? measured in Fig. 6, for the suddenly 
applied sinusoid, is 


Cree ell. (49) 


Thus the measured value is lower than the calculated 
value of émin by about 15 per cent. Although part 
of this discrepancy may be accounted for by meas- 
urement and computational errors, there is no doubt ~ 
that the periodicity of the input in the original design, 
as well as the finite change in forward gain, contribute 
to the error. Its value is small enough, however, con- 
sidering the large factor by which e? has been reduced, 
to provide a sound justification for this design technique. 
Furthermore, examination of Fig. 5 reveals that the 
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Fig. 6—Plot of [co(t) —e.(t)]? vs time. 


excursion of the system response from its desired value 
has been considerably reduced, compared to a design in 
which the transient response was ignored, without 
causing the character of the response to change in an 
unusual manner. 

The design procedures for the determination of the 
sensitivities with respect to Z; or P; are similar to those 
outlined in this example. A pair of symmetrical poles 
on the real axis is added to the integrand in (20). If 
these do not significantly reduce the values of the inte- 
grand for the harmonics of wy necessary to evaluate 
accurately the coefficients of No(s), then the design for 
x =k is optimum as well for x=Z; or x= P;. 

The zeros of the sensitivity function become poles of 
the open loop gain B(s)M(s). With increasing loop 
gain, the root loci exhibit a small excursion into the 
right-half s plane. Thus the system is conditionally 
stable, but for the third-order system under considera- 
tion, has a gain margin of 21 db. 
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Fig. 7—Plot of [co(t) —cr(t)|? vs time. 


CONCLUSIONS 


A mathematical definition of feedback sensitivity has 
been formulated. It has been shown that a feedback 
system sensitivity function may be so chosen that the 
system’s forced response to a specified input is invari- 
able with parameter changes. A mean square error cri- 
terion may be utilized to determine a suitable sensitivity 
function for minimizing changes in the system’s tran- 
sient response. Although the input function must be put 
into the form of a repetitive signal, in order to carry out 
the required procedure, the resulting design has been 
shown to have considerable merit for an aperiodic in- 
put, in a specific design example. The system so de- 
signed is conditionally stable, and has an open loop gain 
with poles very close to the imaginary s axis. 

This new criterion is intended to be introductory to 
the more general study of relationships between varia- 
tions of over-all system response and the sensitivity 
function. For example, the minimization procedure may 
be rederived, based upon various performance con- 
straints. Multivariate designs may be developed. Mini- 
mum integrated square and other error criteria have 
extended the results of this paper. 
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Synthesis of Linear, Multivariable 
Feedback Control Systems” 


ISAAC M. HOROWITZ 


Summary—A multivariable controlled process or plant is one in 
which there are n independent inputs and m outputs with n>1 and 
m<un. A control problem may exist for one or two principal reasons. 
1) The plant parameters may vary or they may be only vaguely known, 
and the system response sensitivity to the parameter variation is to 
be reduced. 2) The system response to disturbances is to be reduced. 
A synthesis procedure for attaining these objectives and simultane- 
ously realizing a desired set of system transmission functions is de- 
veloped in this paper. The role of system configuration is considered. 
Design is broken up into two separate regions. In the significant 
system-response frequency region, there is straightforward synthesis 
in attaining the design objectives. In the higher frequency range, the 
loop transmission must be shaped so that the system is stable. The 
latter problem is considerably more difficult when there are sub- 
stantial plant parameter variations. Some procedures are illustrated 
by two detailed examples (n=m=2 in one example, and n=3, m=2 
in the second) in which there are large plant parameter variations. 


INTRODUCTION 
\ MULTIVARIABLE (or multipole!) controlled 


process or plant is one in which there are 1 in- 

dependent inputs, «1, %2, - - - ,X,, and m outputs 
CirOis ce 
but not necessarily, greater than one. Examples of mul- 
tivariable plants are the control systems of turbojet 
engines, of airframes, and of steel rolling mills. The 

‘following problem is treated. Consider a given multi- 
variable plant with its input-output relations expressed 
by an m Xn matrix of transfer functions. It is assumed 
that the control engineer must work with the plant as 
it stands and cannot change its parameters and that the 
output cannot be influenced except through the plant. 
A control problem exists for one or two principal 
reasons. 

1) The plant parameters are subject to variation. 
Typical reasons for such variation are changes in en- 
vironmental conditions or in quiescent operating points; 
changes inherent in the nature of the plant, such as a 
change in mass due to fuel consumption, etc. It is as- 

-sumed that if there are p significant plant parameters, 
it is possible to fix a closed region in p-dimensional space 
such that over the range of life and operation of the 
plant, the parameters may be found in that region. 

Ignorance of the plant parameters may be included 
under this heading provided that, as in the above, a 
bounded region of plant behavior may be fixed. How- 
ever, such ignorance cannot be too great. At least the 
physical capabilities must be known so that the plant 
is not expected to do what it is unable to do. 

* Manuscript received by the PGAC, October 9, 1959; revised 
manuscript received, March 7, 1960. 

+ Res. Labs., Hughes Aircraft Co., Culver City, Calif. 


1H. Freeman, “A synthesis method for multipole control sys- 
tems,” Trans. AIEE, pt. II, vol. 76, pp. 28-31; March, 1957. 
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2) The second principal reason for the existence of a 
control problem is that the plant is subject to external 
disturbances and it is desired to control the effect of 
such disturbances. Here, too, at least a closed region of 
possible range and characteristics of the disturbances 
must be known. 

This article is an extension of the work done by sev- 
eral authors!‘ in which the principal results reported 
in the literature have been concerned with the synthesis 
of a desired over-all set of system transfer functions. In 
addition this earlier work is subject to some constraints 
such as noninteraction,?* use of a diagonal loop- 
transmission-matrix,! and the assumption of small pa- 
rameter variations‘ to simplify thestability problem. The 
purpose of this paper is to consider simultaneously how 
one can realize a matrix of system functions and an in- 
sensitivity of these to plant parameters variations, 
and/or a specified degree of system insensitivity to ex- 
ternal disturbances. It may be argued that were it not 
for the latter two problems, there would be no need to 
apply feedback around the plant. A set of system trans- 
fer functions alone may be obtained much more cheaply 
and with considerably less design effort by cascading 
the plant with suitable prefilters. The treatment of the 
problem in this paper is subject to one serious limita- 
tion; 7.e., the relations between the inputs to the plant 
and the resulting outputs are linear. It is known that 
even for a nonlinear plant (excluding saturation) the set 
of linear system functions with reduced sensitivity to 
parameter change may be attained over the significant 
system frequency range. However, with a nonlinear 
plant, the crucial difficulty of insuring system stability 
remains a nonlinear problem and is outside the scope 
of this paper. 


THE ROLE OF SySTEM CONFIGURATION IN 
ACHIEVING DESIGN OBJECTIVES 


This section considers to what extent the design ob- 
jectives are achievable and the role of system configura- 
tion in obtaining them. It is assumed for the moment 
that the plant is accessible only at its input and output 
points. There are therefore only three sets of variables, 


2 A. S. Boksenboom and R. Hood, “General Algebraic Method 
Applied to Control Analysis of Complex Engine Types,” National 
Advisory Committee for Aeronautics, Washington, D. C., Tech. 
Rept. No. 980; April, 1949. 

§R, J. Kavanagh, “Noninteraction in linear multivariable sys- 
tems,” Tvans. AIEE (Applications and Industry), vol. 76, pp. 95-100; 
May, 1957. 

4H. Freeman, “Stability and physical reliability considerations 
in the synthesis of multipole control systems,” Trans. ATEE (A ppli- 
cations and Industry), vol. 77, pp. 1-5; March, 1958. 


1960 


each set represented by a node in Fig. 1(a). R is an 
nX1 matrix whose elements are the Laplace transforms 
of the input command signals, X is an mX1 matrix of the 
plant input signals. P is the m Xn matrix of plant trans- 
fer functions, and C is the m X1 matrix of output signal 
transforms. 

Since no signal is allowed to reach node C except 
through P, the system response is entirely determined 
by the values of X. Also, X must be determined by the 
signals it receives from R and C. There are accordingly 
only two essential sets of transfer functions, one from 
R to X and the other from C to X |see Fig. 1(b) ]. 
Therefore, as far as the design objectives are concerned, 
Fig. 1(b) is sufficiently general and no other configura- 
tion can do any more. For example, Fig. 1(c) appears to 
possess more degrees of freedom, but it is reducible to 
Fig. 1(b), with G=G1G.G;3, H= H3;+G3H2+G2G3;M, and 
the effect on the design objectives is precisely the same. 
This means that there are two degrees of freedom which, 
it will be shown, may be used to determine a matrix of 
system transfer functions 7(C=T7R) and, independ- 
ently, either a set of sensitivities of these transfer func- 
tions to variations in plant parameters or a matrix of 


R 
° o— 


(c) 


Fig. 1—(a) The three essential variables. (b) A sufficiently general 
configuration. (c) Alternate and more complex configuration. 
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Fig. 2—Six alternate configurations. 
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system responses to external disturbances entering the 
plant. When there is access to more variables within the 
plant, z.e., when the designer may feed back from points 
other than the output terminals, the above conclusions 
are not seriously modified. [t is then possible to control 
independently the sensitivities of 7 to various portions 
of the plant or to control separately the system response 
to disturbances entering at different points in the plant. 

It is interesting to inquire whether there may be sub- 
stantial differences between various configurations in 
such matters as system sensitivity to the compensating 
networks and system response both to noise entering 
elsewhere than via the plant and to the gain-bandwidth 
requirements of the compensating networks. Since it 
does not appear possible to generalize, a numerical ex- 
ample for a single-variable plant is considered. The six 
different configurations shown in Fig. 2 are compared 
with respect to (a) the gain-bandwidth demands on the 
compensating networks, (b) the sensitivity of the sys- 
tem to the compensating networks, (c) the level of the 
output at various points for noise entering with the use- 
ful signal, and (d) the noise entering through the feed- 
back path. For a fair comparison all configurations have 
the same loop transmission in order that they may all 
be the same with respect to the major design objectives. 
This means that they all have the same loop trans- 
mission L, and the same 7 =C/R, at least over the sig- 
nificant frequency range. The example chosen (Fig. 3) 
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Fig. 3—Example of single-variable system. 
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TABLE I 
TABLE OF G AND H FUNCTIONS AND SIGNAL LEVELS FOR CONFIGURATIONS SHOWN IN FIG. 2 
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corresponds to the lead type of compensation since the 
system-response bandwidth is greater than that of the 
plant. The bandwidth over which there is negative feed- 
back (with all its advantages) is about two and one-half 
times the system-response bandwidth, and the gain and 
phase margins are fairly conservative. It is assumed 
that the magnitude of the system response 7=C/R is 
prescribed up to the frequency (5.7 rps) at which it de- 
creases to — 20 db. In this example, the plant is driven 
hard to give a response faster than its own natural in- 
clinations and appreciable loop gain L (1.e., the benefit 
of negative feedback) is desired over a much larger 
bandwidth than the plant is capable of giving. It is not 
surprising, therefore, that the compensating networks 
must have large gains over a frequency range consider- 
ably greater than that of the system itself. The example 
thus represents one of the more exacting types of design. 

Can any significant conclusions be drawn, at least for 
this kind of design example? G and H functions for the 
various configurations in Fig. 2 in terms of 7 and L are 
given in Table I, and Bode plots of the various G and 
H transfer functions are drawn in Fig. 4. In some cases, 
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Fig. 4—Characteristics of the configurations shown in Fig. 2. 


a compensating network (a G or an H) must make up 
the difference between the gain-bandwidth demands of 
the loop transmission L and the amount supplied by the 
plant P. In other cases, a compensating network must 
supply the difference between the requirements of both 
T and LZ and the amount contributed by P. 

The various configurations permit different divisions 
between the G’s and H’s. Configuration A has an advan- 


} 


1960 


tage over B because T enters only in the expression for 
G, and therefore T can be brought down very fast to 
ease the demand on G,. This cannot be done with the B 
structure. In the latter, both G and H must be under 
control until L becomes less than P; in this example 
this occurs more than two decades beyond the system 
bandwidth. The C structure (called conditional feed- 
back® or model feedback) is substantially the same as A. 
In structure D, Hq is fairly independent of T and there- 
fore this structure has the same advantage over B that 
A and C have; 1.e., only one function, H41, need be con- 
trolled over a very large frequency range. Structures E 
and F represent modifications of A and D, respectively. 
There is some advantage in B, D, F over A, E: up to 
approximately 15 rps, the feedback is negative and 
therefore over this limited frequency range the G ele- 
ments in B, D, F benefit. There is no particular ad- 
vantage in £ over A in the gain-bandwidth demands but 
there may be an advantage in F over D. In F, 


Cn = (1 
Ay = Ge 52Gj1. (2) 

If Gy2 is made equal to L/P, then 
Ca “— (3) 


can probably be passive but H;1:=1 must be controlled 
over a wide frequency range (until Z is equal to P). In 
return for the latter, the requirements on Gy; are very 
slight. There may also be some advantage in EF and F 
in terms of the required dynamic range of the G’s and 
H’s, especially if high-frequency noise is a problem. (The 
noise output of the over-all system is exactly the same 
for all the configurations for noise that enters with the 
signal or that enters anywhere in the plant, or at Nin 
Fig. 2 via the feedback loop.) The signal level at the out- 
put of G, in Fig. 2(a) is, of course, G, with its peaked 
high-frequency response. In Fig. 2(e) it can be reduced 
by letting G,2 be larger, without affecting the level at the 
output of G.2 which is fixed at 7/P. There is a similar 
saving in the signal level at the output of H,. However, 
each of the high-gain elements in each configuration is 
very susceptible to high-frequency noise, entering by 
the feedback loop via NV. It would seem from the above 
that there may be some advantage in configurations 
with more than the minimum two degrees of freedom, 
and that these advantages are in the gain-bandwidth 
and in the dynamic range requirements of the compen- 
sating networks. In an example such as the above, the 
difference in system sensitivity to the compensating 


5 G. Lang and J. M. Ham, “Conditional feedback systems—a new 
approach to feedback control,” Trans. AIEE (Applications and In- 
dustry), vol. 74, pp. 152-161; July, 1955. : 
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networks is minor because the demand on these net- 
works is chiefly over that frequency range in which the 
loop transmission is less than unity. 


STEPS IN THE DESIGN OF A MULTIVARIABLE 
CONTROL SYSTEM 


There are three principal steps in the synthesis of a 
multivariable control system. 

1) Realization of the desired set of system transfer 
functions (the matrix 7) over their significant frequency 
range (roughly an octave or two beyond their half- 
power points, unless there are special reasons for going 
beyond). It is not a good idea to try a priori to specify 
the behavior of the elements of 7 beyond this range, as 
will be seen when step 3 is considered. 

2) Next, the magnitude of the loop transmissions 
over the significant frequency ranges must be fixed in 
order to obtain the desired insensitivity to plant pa- 
rameter variation and/or the desired rejection of dis- 
turbing signals. 

3) Finally, the loop-transmission functions should be 
allowed to decrease in magnitude as fast as is consistent 
with the stability problem in the face of the plant 
parameter variations. This involves design effort well 
outside the useful system frequency range. The prac- 
tical aspects of design are best handled at this point. 
Thus, it is unrealistic to specify building blocks whose 
transfer functions have more or even as many zeros as 
poles. Nevertheless, such functions usually result from 
the first two steps. In step 3, the additional poles may 
be introduced as soon as feasible without affecting sys- 
tem stability. That is why the behavior of the 7 ele- 
ments in this far-off frequency range is best left to this 
part of the design. The final result is a design without 
the ambiguities of building blocks with transfer func- 
tions that are infinite or even finite at infinite frequency. 
These three steps will now be considered in detail. 


Step 1—Realization of T 

The plant has ” inputs and m outputs. If n<m, 
m—n outputs are dependent functions of the others and 
may be ignored, leaving a plant described by an nXn 
matrix P. If m<n, n—m fictitious outputs are invented, 
precisely equal to n—™m inputs, so that again there re- 
sults an Xn matrix P that describes the plant. For 
example, if ~=4, m=2, the plant matrix is 


piu pin =pis pia 
pa po. pox pra 
On 0 1 0 
OPI 1 


ea 


L 


The above procedure is the same as that described in 
the literature! except that in this paper P will not be 
shown in partitioned form. The configuration used in 
the development is that shown in Fig. 2(b); it is re- 
drawn in Fig. 5. If any other configuration should be 
preferred, the values of the new building blocks can be 
obtained from G, P, and H. 
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Fig. 5—Multivariable feedback control system configuration 
used in developing the synthesis procedure. 


Capital letters are used for matrices, of which there 
are two kinds: 7.47 matrices, such as J, P, H, G; and 
nX1 matrices representing transforms of signals, such 
as R, E, X, N, M, C. The matrix elements are designated 
by small letters with pairs of subscripts to denote their 
position in the matrix, e.g., pi;, hij, tij, gi; Capital letters 
with pairs of subscripts denote cofactors, e.g., P;; is the 
ajth cofactor of P. The determinant of an m Xn matrix 
is indicated by the A notation; e.g., A,, A, are the deter- 
minants of P and G, respectively, while Ap is the deter- 
minant of the matrix of the cofactors of P. 

In Fig. 5, with the external disturbances N= M=0O, 


C = PX = PGE = PG(R — HC); (4) 
therefore 
Gri POPGHetPGR = TR, (5) 
from which 
H= fF *— (PG). (6) 


Or one may write 


E = R— HPGE, (7) 
and therefore 
C = PGE 
= PG(I + HPG)R 
= TR, (8) 
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(I + PGH)—PG 
PG + HPG)-. (9) 


Eq. (9) is used to find H in the significant frequency 
range of 7, as noted in step 1. It can be applied as soon 
as G is known, because J and P are known a priori. G 
is obtained from the desired insensitivity of the 7 ele- 
ments to variations in the parameters of P and/or the 
desired response to the external disturbances, NV and M. 


Step 2—Effect of Variations of Plant Parameters 

T is the nominal transmission matrix when the plant 
has the nominal matrix P. When the latter has a dif- 
ferent set of values P’, the resulting new transmission 
Mathixis 1° 47.6. 


Pl ge PHP. (10a) 
T’ =T+ AT. (10b) 
Since 
T = PG + HPG), (11a) 
T’ = (1+ PGA) NPG, (11b) 
and from (9) and (10), 
DAT = TO eG ae GH) 
-[(P'GH + I P’G — (PGH + I)~'PG| 
= G'p'-!{ P’'G — [(P + AP)GH + I] 
-|(PGH + 1)-'PG]} 
= G'PSYAP)GU — AT). (12) 
With the aid of (6), the latter becomes 
l'3AT ='GoP APP IT AS 
(A means “equal by definition”). (13) 


Let the elements in AP be designated by 6;; and those 
in AT by 7,;, and multiply out both sides of (13). The 
result is (recall Pag is the cofactor of the a@ element in 
the P matrix, etc., A, is the determinant of P, Ap is the 
determinant of the cofactors of P, etc.), 
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The set of 1 r’s denoted by 71 is obtained from the n 
simultaneous equations derived by equating the 7 ele- 
ments in the first column of (14); z.e., 


Mew Pm fora=a1,2,-: 7, 
j 


(15) 
By using Cramer’s rule, 


A 
CT a Dt (siaMar + SoMa +++ + Sn1Mni1), (16) 


me 


where M;; is the 7j cofactor of the Ay7’— matrix. By 
Jacobi’s theorem,® 


Miz = ty! Ap", (17) 
while 
Ar = Ap", (18) 
Therefore, 
7p — "Sita + Seitis’ -1- > > > + Saalin’. (19) 
In general, 
Teg Solas. (20) 


From (14) and by letting 6,” represent the Kronecker 
delta, 


ApAp AgSap = ys Py Gichy; Prityp 

= >) Py Giabuj! Poitop — D, Py! GiabysPvibys 
DY Apdj*GiaPrjtes — >> Apd.” Pri’ Giobop 
Ap d+ GiaPvitys — Ap >, Pri Giatyp 


| 


= >> Gabs(Ay Pa — ApP’). (21) 
Therefore, 
Vee, Poe 
AgTap = > bad Gates ( A, — —) (22) 
For example, if n=2, 
\ ul Py 
Agriz = (t11’Gur + tre’Gi2) | tre — — 
D A, 
ay ( 21 “= 
22 iG ae 
: Pie Px)! 
+ (t1'Go1 + tre’Goz) | tre We a Ay 
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+ toe (= ar )}. (23) 
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The r’s, which represent the arithmetical change in 
the transmission, may be kept as small as desired by 
choosing the g’s sufficiently large. If over the useful fre- 
quency range the r’s are to be kept small, 


tag’ = bo, (24) 


6H. W. Turnbull, “The Theory of Determinants, Matrices and 
Invariants,” Blackie and Sons, Ltd., London, Eng., 2nd ed., p. 77; 
1945. 


Horowitz: Synthesis of Linear, Multivariable Feedback Control Systems 1g) 


and (22) is approximated by 


Wes Pie 
Mira = De Gistasts (<= - ). 


yc Ne 


(25) 


If it is assumed that the 7’s and P,,’’s are known, one 
may formally solve (25) for the n? unknowns G;,;/A,, 
from which the g;; elements are available. Once the 
latter are known, the H matrix elements are obtainable 
from (6) and the synthesis in the significant 7 frequency 
range is complete. 

Only in very exceptional cases would the design effort 
required above be justified. All the 7’s may be kept as 
small as desired by letting G be a diagonal matrix. In 
this case (25) becomes 


Leily ve a 
Tog = SS (< 2 ) 
gic \Ap Ap 
It is clear from (26) that it is always possible to choose 
the g;,;s sufficiently large to make the r’s as small as 
may be desired. 
When rejection of disturbances is important, one is 


interested in the noise transmission matrix, which from 
Fig. 5 is 


(26) 


Ding = 1 oe PGA eR. CO) 
From (9) it therefore follows that 
T = TyG. (28) 


G is chosen to obtain the desired noise attenuation. If 
G is a diagonal matrix, 


bap 
tna = aa (29) 
Sai 
For noise entering at the output points (Fig. 5), 
TPG (30) 


and G is chosen to attenuate the noise to the desired 
extent. 


Step 3—Loop Shaping for Stability 


The final and usually the most difficult part of the 
synthesis is to shape the loop transmission in the cross- 
over region to insure system stability despite plant 
parameter variations. Consider (9) written in the follow- 
ing form: 


Teer Cie Pe (31) 
P’, T’ denote the plant and system transmission mat- 
rices, respectively, at the new values of the plant pa- 
rameters. Although it is known that 7 is stable, the 
problem is to choose H and G outside the 7 frequency 
range such that the system remains stable over the 
range of P’ values. Right half-plane poles of P’G are 
cancelled out in 7’. Right half-plane poles of H appear 


- at worst as zeros in some of the ¢;;’. Instability is due 
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only to zeros of | I+ P'GH| in the right half-plane. Con- 
sider | T+X . In general, 


| T+ X| =aA,4+ DS Xue + DY Xe FD Xicis en 
1 
ecg cie| = DS NGS Ps oe shale eas (32) 
while 
UI dp PG IIE DS Ay. Se De Oey. 
it1,jt] F+1,i41 
+ 0 Pin Xi, j,i 
UGH ED) aL P16 t 
G42,G4+2,b42 b4+2,74+2,042 
See es (33) 


In the above, X;; is the (7z)th cofactor of X; X;;,;; is the 

determinant obtained by striking out the 7 and 7 rows 

and columns of X; P;; ’ is (—1)**'**™ times the deter- 
l,m 


minant obtained by striking out of P’ rows 2, / and 
columns 7, m. Also, 
Xie = XGA. (34) 
aj 

Suppose now that there are r quantities in P’ that 
are variable. The range of values of these yr quantities 
describes a closed region in r-dimensional space. For 
any one point in this r-dimensional region, the Nyquist 
sketch of the loop transmission must not encircle the —1 
point. If y=3, then the closed region is in visualizable 
space. To explore this region, it is enclosed in a larger 
but simpler type of region, preferably a solid bounded 
by planes. To investigate thoroughly the latter region, 
the eight Nyquist sketches, corresponding to the eight 
corners of the region, must be sketched. From these 
sketches it is ascertained whether the system is stable 
for all points in the three-dimensional region. This 
method is described in detail in the literature.7* A 
modification of this procedure, which may be useful, is 
shown in the examples at the end of this paper. A cer- 
tain amount of cut and try is inevitable. A guess is made 
at suitable GH values from which the loop transmissions 
are sketched. The sketches suggest the changes that 
must be made should the original trial lead to an un- 
stable system. 

Undoubtedly the above procedure entails a great deal 
of tedious calculation but this appears to be unavoid- 
able. The work can, of course, be done on an analog 
computer by simulating the 2-dimensional system and 
opening the loop at any single point. For example, if 
n=2 and the loop is opened at pi’ (Fig. 6), then the 
input is applied at point A and the output at point B is 


7R. M. Stewart, “A simple graphical method for constructing 
families of Nyquist diagrams,” J. Aeronaut. Sciences, vol. 18, pp. 
767-768; November, 1951. 

8F. H. Blecher, “Transistor multiple loop feedback amplifiers,” 
Proc. Natl. Electronics Conf., vol. 13, pp.19-34; 1957. 
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Fig. 6—Loop transmission around pn’. 


the loop transmission around /41’. The value of this loop 
transmission is obtained by expanding (33). 


| 1 Poa = 1+ poo! 22 + por’ ai2 + pis’ xa1 


— pro! por'Az + pir (Poo’Ae + #11). (35) 
The loop transmission around f1;’ is therefore 
: — pir (po2/Az + 411) 
Lops, a (36) 


1 + poo’%20 + por’X12 + pro’X21 — pre! por’ Az 


and is the quantity measured at B. There is no need for 
a separate simulation of G and H. The elements of 
X =GH must have their correct design values over the 
T frequency range and the designer’s problem is basi- 
cally how to bring these values down reasonably fast 
(in order to economize on gain-bandwidth) without 
making the system unstable for some value of P’ in its 
region of variation. A reasonable procedure is to assign 
to X a set of functions and then measure Lip, for a 
few frequencies over the range of P’. One soon finds the 
important crossover frequency range, and by sketching 
the loci and examining (36) eventually finds a satis- 
factory set of values for X. After X is known, GAH is 
known, but there is freedom in the individual choice of 
G and H. This freedom is used to insure that T falls 
off as fast as may be desired outside its useful band. 

One can now appreciate the great increase in the de- 
sign effort in loop-shaping for stability that must be 
expended in going from the single-variable control sys- 
tem to even the two-variable system. In loop-shaping 
to insure stability despite plant parameter variation, 
the great desideratum is to be able to work with a single 
loop-transmission curve (even though the loop trans- 
mission changes with parameter variation) and shape it 
to avoid a forbidden region. In the single-variable case 
(35) becomes 


/ 
(eet ces, (37) 
p 
where /) = pgh is the nominal loop transmission. There- 
fore sketch p/p’ for all possible plant variations (no 
matter how many plant parameters may change) and 
shape the nominal loop transmission J) such that it 
avoids the locus of p/p’. This is childishly simple com- 
pared with the effort involved in picking x’s in (35) 
which are suitable when the range of variations of the 
primed p’s is taken into account. 


1960 


Noninteraction 


Design labor in steps 1 and 2 is significantly reduced 
when the specifications demand or permit the principle 
of noninteraction? to be applied. The latter is simply the 
condition that 7 is a diagonal matrix. For this case, the 
sensitivity equation of (25) becomes 

/ 
ales = 3 Gictaatge (= = ~) é (38) 
A» 
Again it is possible to keep 7 as small as desirable with 
G a diagonal matrix; in such a case, each Tag consists 
simply of 


laalgs Pee ae 
T «8 = : 
aa \Ap Ay’ 
The proper choice of the diagonal G matrix is straight- 


forward. The elements in the H matrix are also easily 
found from (6): 


(39) 


1 
fF Ons 0 
ty 
yy hy Nin 1 
hoy hoo han 0) — 0 
= 2 
he [Pes ' 
: 1 
0 eek, 
by 
1 
— 0 1) 
¥ ; faeces aes 
—| 0 — Pin Poe ices (40) 
§2 ; 
‘ Was 


1 Pde 

han = — — (41) 
Wetee Baaly 
ay P is 

pe > for ai 8. (42) 
SaaAp 


The selection of H and G in the T frequency range is 
therefore easy. However, if there is substantial plant 
parameter variation, major design effort is outside the 
T frequency range and proceeds as before. The matrix 
X=GH of (33) is easier to calculate, and once its final 
value has been chosen, it is easier to select appropriate 
individual values for G and H, but the shaping of the 
loop transmission remains substantially as difficult as 
before. 

One more simplification may be made. If there is sub- 
stantial plant parameter variation, the achievement of 
noninteraction is illusory because, from (42), it is 


ape es 
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achieved only at one value of the plant parameters. Ac- 
tually, the off-diagonal terms of 7 can be made as small 
as desired in the 7 frequency range by choosing the ele- 
ments of G sufficiently large. The off-diagonal trans- 
missions are essentially equivalent to external disturb- 
ances in a diagonal type of plant and are reduced in the 
same manner by large g terms. Therefore one may also 
make /T a diagonal matrix. Essentially what all this 
amounts to is that in the 7 frequency range, large loop 
transmission leads to 7+H™, just as in the single- 
variable system ¢=1/h. It is important to note that the 
pure synthesis effort is only in the 7 frequency range. 
Loop-gain shaping for stability in spite of plant pa- 
rameter variations remains a major problem despite the 
fact that with both G and A diagonal matrices, X =GH 
is diagonal and the loop-transmission calculation is 
simplified. Thus for 7=2, (35) becomes 


[2+ PX| = 1+ poole + pi’er + Apres. (43a) 


There is one special case worth mentioning. Suppose 
that either p12 or poi is zero; then (43a) becomes 


| 24+ P'X| = (1+ poo'm)(1 + pu’a) — (43D) 


and the stability problem is tremendously simplified. 

When feedback is used primarily to reject disturbing 
signals and there is little plant parameter variation, it 
is obvious that the problem of loop shaping to insure 
stability is considerably reduced. 


Example 1 


Specifications : 


45) co) . 


The quantities a, b, c, 7 can each have a value any- 
where from one to four. With regard to 7, fi; and fo. are 
to have bandwidths of 4 and 1 rps, respectively. The 
values of 1, and fg. are not to change by more than 10 
per cent from dc up to their half-power points. Also fr. 
and fo; are to be each less than 0.05 over the useful 
frequency range. 

Design: The magnitude of the g’s in the useful fre- 
quency range required to maintain the desired insensi- 
tivity is first ascertained. From (39), 


£uT11 t (- + sr Bt 1+ “) (45a) 
ti? a a’ 
£22T 22 1 1 
ga) St 
b b’ 
pn _(% _¥) os 
too” dG mane: 
toy = Ta = 0. (45d) 
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Suppose that the nominal values of the parameters are 
taken to be a=b=c=1,7=4. Then the maximum value 
of (45b) is 2, while the extremes of (45c) are —15/16 and 
3. Therefore go. >7.5 up to approximately 1 rps, and gi 
must be >60 ups to 4 rps. This value of gi; is more than 
enough to satisfy the specifications on 711. 

The next step is to shape the loop transmission so that 
the system remains stable despite the known extremes 
of plant parameter variation. In this example, (43b) 
applies, and 


xa’ 
(1 + x20’) (1 + ) 
rst 


must have no right half-plane zeros. Since «2= gosh, 
X1= £1111, it is desirable that each x have at least two 
poles and that it decrease with frequency as rapidly as 
possible to make the demands on the g’s and h’s as easy 
as possible. This decrease should be accomplished sub- 
ject, of course, to the requirements on the g’s in the use- 
ful frequency range and in order that the zeros of 
| I+P’X| should not be too much underdamped. It is 
easy to pick a simple x. with two poles, v7z., 


_ (7.5)(25) 
(s+ 1)(s + 25) 


Xo 


such that in the worst case, when c’=4, the damping 
factor of the zeros of 1+.x.c’ is approximately } and in 
the useful frequency range g.~7.5 because h.1 in this 
range. 


(b) 
Fig. 7—Nyquist diagrams. (a) Stable, (b) unstable. 
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To find a suitable x;, consider the zeros of 


sti 
(SS + v1) =fithe 


a 


(46) 


It is necessary that the locus of x; be properly shaped 
with respect to the loci of 


(= —+ -) 
a’ 
For example, Fig. 7(a) represents a stable system and 
Fig. 7(b) represents an unstable system; Fig. 8(a) is 
stable and Fig. 8(b) is conditionally stable. In our 


specific problem from the point of view of stability we 
are being conservative if we approximate 


—fi= 


rst1 


Bike em 


a’ 


by (7’/a’)s=hs with h a number that may have any 
value between 1 and 4. To guard against conditional 
stability and to obtain a locus like that in Fig. 7(a), the 
phase lag of x; should be less than 90° so long as 
|x:| >|fi|. With a little experimentation, a conserva- 
tive value of x; is found to be 


4000(s + 1.5)? 


A = gurir -¥ 


1 b} 
(s + =) (s + 20)(s + 30) 


(b) 
Fig. 8—Nyquist diagrams. (a) Stable, (b) conditionally stable 
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Now that X1= 21h, X2 = Pooh. are known, (41) is 
used to obtain 


13 1 

uli = Dee be a(s a =) (47a) 
§22 

S22Mx2 = , = il. (47b) 

If we pick 
21255 (s + a)(s + 25) 
too ae aa E * 5) (48a) 
25a (s + 1)(s? + 26s + 212.5) 


’ the design of goo and hy, then 


8.5(s + a) 


a(s + 1)? oly 


Soot 


(s + 1)(22.5a) 
ho = (48c) 
(s + a)(s + 25) 


The value of a may be a compromise between the desire 
to bring hz. down as fast as possible and the require- 
ments on fo». 

From (47a) and the value of x, 


git A(s + 1.1)(s? + 1.85 + 4)(s + 16) 


z (49) 
thy (s + 0.5)?(s + 20) 
If t1; is taken to be 
0.1 20 
1 = e 2 ) ? (50a) 
(s + 3)(s? + 1.85 + 4) 
then 
0.4(s + 1.1)(s + 16) 
SiS i (50b) 
ee am 
and 
10,000 0.5 475)2 
hii Dea le (50c) 


alF ee AG OG E 20) (se 30) | 


The synthesis is complete and there is no ambiguity 
in the g’s and h’s since they all have more poles than 
zeros. When the above values are substituted into (9), 
the results check with the above and ft. satisfies the 
specifications. 

The design effort in the above example was not great, 
thanks to the fact that p21 was zero. 
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Example 2 


Specifications: A plant with three inputs and two out- 
puts. The plant matrix is 


f ay 0.5a» 1 
P= 0.5a; ae 0.5 ’ (51a) 
ae i] 
@) t +1 


from which the matrix of the cofactors is found to be 


' ay —(0.5a, 0) 
oa —(0).5a ay 0) (51b) 
(rs + 1)? 
—(0.75a5 0 0.75a,a9 


The parameters 7, a1, @2 may each have values anywhere 
from one to four. The bandwidth of f1; and ts. is to be 
each 1 rps and the values of f1; and tg. are to vary by not 
more than 10 per cent in this range due to plant parame- 
ter variation. The cross transmissions fj2, to1, etc., are 
to be less than 0.05 over the 1-rps bandwidth. 

Design: Because of the significant parameter varia- 
tions there is no point in adjusting for noninteraction; 
hence diagonal G and H are used. With the aid of (39) 
and with f;;=¢f22, the variations in the transmissions are 
found to be 


T31 = T32 = T23 = O (52) 
4 tii? TS + 1 7's + 1 

ale = ( a ; ) = — 2112 (53) 
3 £11 ay ay 
2 ge t's + 1 TS + 1 

i oe ( ie ) seria ey es 
3 £22 ae ae 
tyitss aS + 1 TS) + 1 

fis == pent ie i (55) 
11 a ay 


The nominal values of the plant are taken as 
a1=d2=2, r=4; ts3 is taken as unity and since 33=1, 
a constant, there is no need for feedback around this 
variable; hence 43; =0 and g33;=1. The specifications on 
the 7’s are satisfied if gi: and go are each 30 over the 
passband. We can also take fti=foe=t, 211=222=8, 
hy =ho=h; therefore x11 = 1111 =X2 =X, and , of course, 
x3 = 0. 

The stability problem is greatly simplified by the fact 
that x3=0. The polynomial (33) that must be examined 
for no right half-plane zeros is 


0.7541! ao’ x1x2 ay’ x1 dy’ Xo 


Tsp iy rst1! sti 


This is rewritten as 


ay’ a2! 


f 1 
¢ a ) [r’s + 1+ (ay + aa’)x| + 0.75x? 


=fit fr. (56) 
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The discussion regarding Figs. 7 and 8 applies, except 
that the problem here is more difficult because fi is a 
function of fo. But with some preliminary thinking, the 
specific loop-shaping required is apparent. The function 
x = gh should have at least two more poles than zeros to 
permit a realistic g and a realistic h. Therefore, assuming 
lead compensation at low frequencies is not needed, 
0.75x?=f. will have the frequency locus indicated 
(qualitatively, of course) in Fig. 9. At low frequencies 


sti 
— fs —( : 7) (ad + a)» 


ay/ a2 


and it would therefore be like the segments M,; or My» 
in Fig. 9. At high frequencies 


a —(r’'s + 1)? 


ay Qs 


=f; 


and therefore —f; tends toward the positive real axis, 
as shown in the: figure. In order to have the situation 
shown in Fig. 8(a) (unconditionally stable), it is neces- 
sary to decrease the magnitude of f, without too much 
phase shift (this is always the problem in loop-trans- 
mission shaping). 


Fig. 9—Preliminary construction for requirements on x. 
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this is sketched in Fig. 10. The resulting —f; and fs are 
sketched in Fig. 11 for 7 =4, a1 Ne esl, On = Cin = 13 
r=1, G,=a,=4 andvior 7—4, d,=a,—, Consider the 
loci of —fia, —fie. As 7 changes in value from 1 to 4 
(with a,=a,=4), the point corresponding to w=4 de- 
scribes a locus starting from A and terminating in B 
(see Fig. 11). For the system to be stable, this locus must 
pass to the left of C, which is the point of w=4 on the 
fe locus. Similar loci between corresponding points on 
the —f; curves must be considered. It appears that the 
design is very likely stable but would, in any case, re- 
sult in system poles which at some plant parameter val- 
ues tend to be too much underdamped. 

It is clear what should be done to remedy the matter. 
The design for x; must be more conservative with less 
phase lag for the same decrease in magnitude (with con- 
sequent need to control x over a larger frequency range). 
The final try uses (see Fig. 12) 


—_ 16)8(32)(5 + 2)%s + 16)%s + 128) 
w “(eb 1) 3G Bs ote IN 


which is probably more conservative than is necessary. 
The resulting —f; and fy sketches-appear in Fig. 13. 
Clearly, the system is stable for all permissible values of 
the plant parameter. 
Now that «= gh is known, (41) is used to find g/t; 2.e., 
Pee 
ae 


Love 4 
= LION ies se x =e ae) 
bay Ap 3a 


(0%) 


(58) 


(59) 


2, 
=x+—- 
3 


Two near zeros of Zaa/tae are quickly located by ap- 
proximating x by 8(s+2)?/(s+1)?. The second approxi- 
mation for x is 
RCS) sea e: 
CR ae Ol grr: 
and with the aid of the first approximation, the resulting 
factors are found. The process is continued until finally, 


21(s2 + 3.865 + 3.80) (s? + 28.45 + 216)(s? + 1885 + 10,150)(s? + 950s + 389,000) 
oe 


If the choice for f is taken as 


first try, a choice was made with 


(60) 
(s + 1)?(s + 8)?(s + 64)?(s + 512)? 
793 
(s + a)?(s + 64)?(s + 512) 
a 
i= ) (61) 
(s + 1)(s? + 28.45 + 216) (s? + 188s + 10,150) (s? -+ 950s + 389,000) 
Because f; depends on the choice of f2, some trial and then 
error is unavoidable. The cut and try is greatly facili- 
tated by rapid polar sketches obtained from Bode dia- 2\ /793\ (s + a)?(s? + 3.865 + 3.80) 
grams of the asymptotic functions. These Bode dia- ous 2 ) 3 2 (62) 
: : 3 a (s + 1)8(s + 8) 
grams are precisely drawn here for illustrative purposes 
but in practice rapid asymptotic sketches suffice. In the eae 
3150(s + 4)? 248a>(s + 1)(s + 2)%(s + 16)%s + 128)? 
: (57) ee Sye 


mae 100)? 


~ (s* + 3.865 ++ 3.80)(s + a)%(s + 64)2(5 + 512)? 
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Fig. 10—Design example no. 2 showing first trial value of x. 
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Fig. 11—Sketches of —fi, fe for determining stability 
(example no. 2, trial no. 1). 


CONCLUSION 


A synthesis procedure has been presented for the de- 
sign of linear multivariable feedback control systems to 
achieve simultaneously: 

1) a desired matrix of system transfer functions, 

2) a desired insensitivity of these transfer functions 

to plant parameter variations. 
The procedure is applicable to systems with large pa- 
rameter variations. No constraints such as noninterac- 
tion or diagonalization of the loop-transfer function 
matrix have been assumed. There is, however, some free- 


40 
30 oP) 
Lu 
2 20 : 
oi Lu 
2 10 = 
= x< 
BY 6 Le 
(ae 
- je) 
=) 20 a 
\ = 
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W,rps 
Fig. 12—Design example no. 2 showing second trial value of x. 
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Fig. 13—Sketches of —fi, fo for determining stability 
(example no. 2, trial no. 2). 


dom in the manner in which the loop-transmission ma- 
trix elements may be chosen to achieve the desired sensi- 
tivity reduction. This freedom may be used, as it was 
used in the numerical examples, to simplify the design 
calculations, or it may be used for practical considera- 
tions, such as to minimize saturation possibilities. One 
of the really difficult problems, when there is large 
parameter variation, is to secure stability despite the 
parameter variation. Some initial cut and try seems un- 
avoidable, but convergence upon a final satisfactory solu- 
tion is rapid. 
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Automatic Control of Three-Dimensional 
Vector Quantities—Part 3° 


A. S. LANGE} 


Summary—This is the final part of a three-part paper on the 
application of vector techniques to automatic control systems whose 
input, output, and disturbance quantities may be characterized by 
three-dimensional vectors. In Parts 1 and 2, position and angular 
velocity vectors were introduced to demonstrate the solution of co- 
ordinate conversion and geometric stabilization problems, respec- 
tively. In brief, the subject of Part 3 is Newton’s Second Law, with the 
application of the previously defined vector algebra to problems in 
kinetics. In particular, the behavior of “Newtonian sensors” such as 
gyroscopes and accelerometers is considered in detail, in order to 
develop the basic equations which describe the dynamic performance 
of these devices, determine the errors associated with their usage, 
and demonstrate the application of the vector algebra to more com- 
plex systems. 


IX. Gyroscopic INSTRUMENTS*”:38 
A important class of problems in applied mechanics 


is that which involves gyroscopic phenomena. 

The gyroscopic principle has many useful appli- 
cations in automatic control systems wherever angular 
motion is to be measured. The basic principle of gyro- 
scopic behavior (Newton’s Second Law) is well known; 
however, the detailed application of this principle to 
problems in three dimensions is often avoided because 
of the complexity involved in accounting for the many 
terms which arise from inertia and kinematic coupling. 
It is therefore of interest to make a somewhat detailed 
analysis of a gyroscopic instrument, as an example of a 
typical problem in kinetics. This example demonstrates 
the behavior of an important gyroscopic instrument, 
and illustrates the use of matrix and vector notation in 
organizing the bookkeeping work associated with such a 
problem. 

The analysis presented here considers the dynamic 
performance of the rate gyro; the rate gyro is mentioned 
briefly in Part 2, Section VI, as a gyroscopic instrument 
which may be used for measuring the angular velocity 
of a controlled member which is to be isolated from the 
motion of a rotating platform. In the following analysis, 
Newton’s Second Law is applied first to the gyroscope 
rotor and then to the gimbal in which the rotor is 
mounted. The interaction between these two bodies 
produces a motion of the gimbal which can be used to 
measure either angular velocity or its time-integral. 

* Manuscript received by the PGAC, March 22, 1960. Parts 1 
and 2 of this paper may be found in the following issues of these 
Transactions: vol. AC-4, pp. 21-30, May, 1959; and vol. AC-5, pp. 
38-57, January, 1960. 

+ Systems Div., Bendix Aviation Corp., Ann Arbor, Mich. 

37 C, S. Draper, W. Wrigley, and L. R. Grohe, “The Floating 
Integrating Gyro and Its Application to Geometrical Stabilization 
Problems on Moving Bases,” Institute of Aeronautical Sciences, New 
York, N. Y., Rept. No. 503; January, 1955. 


38 H. Goldstein, “Classical Mechanics,” Addison-Wesley, Read- 
ing, Mass., pp. 56-176; 1950. 


Both cases are considered and their salient character- 
istics noted. Finally, the nature and magnitude of the 
errors associated these devices are discussed 
briefly. 

In vector terms, Newton’s Second Law for a rota- 
tional body may be expressed as 


M = D;H 


with 


(124) 


where M is the vector sum of the torques applied to the 
body, H is the angular momentum of the body, and D;H 
is the time rate of change of H with respect to some 
chosen Newtonian frame.*® Further, H may be expressed 
as 

H = JW (125) 
where J is a matrix array representing the moments and 
products of inertia of the body, and W is its angular 
velocity with respect to the selected Newtonian frame. 
J is called the inertia tensor,‘® which may be written as 


Jie Us is 
DT = ig teed yy eee } (126) 
ihe: J iy IES | 


The terms Jzr, Jyy, and J,, are the moments of inertia of 
the body about the x, y, and z axes, respectively, and 
the remaining terms are referred to as the products of 
inertia. If the body is considered to be a homogeneous 
solid, then 


Jae f (y? + 22)dm 
B 

Jy = f (a? + 2?)dm 
B 

a f (a? + y?)dm 
B 

J xy = J syam = Jyz 
B 

ope: f xzdm = J xz 
B 

Jy = [yam = Jy 
B 


39 As described in Part 2, Section VI, a Newtonian frame is a 
reference system in which Newton’s Second Law is applicable. See 
J. L. Synge and B. A. Griffith, “Principles of Mechanics,” McGraw- 
Hill Book Co., Inc., New York, N. Y., p. 32; 1949. 

40 Goldstein, op. cit., p. 146 ff. 
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where dm is the element of mass, and the symbol fz in- 
dicates that the integration is to be carried out over the 
body. [If the body is composed of » discrete particles 
rigidly connected, Jrz= 0” (v2+z2)m,, etc.!| It can 
be shown that for any body there is a set of Cartesian 
coordinates such that if the inertia tensor of the body is 
defined with respect to these coordinates, the product 
of inertia terms (Jz,, Jz, etc.) vanish. Such a set of axes 
is called principal axes, and it should be observed that 
for a symmetrical body like a gimbal frame, or a body 
of revolution like a gyro rotor, it is a relatively simple 
matter to pivot these bodies so that the pivot axis and 
a principal axis coincide. 
From (125) it follows that (124) may be written as 


M = D<JW). (124a) 


The central problem here is to evaluate D;(JW) in 
terms of measurable quantities, and equate this term to 
the torques applied to the body. The details of these ex- 
pansions are discussed further in the following sections. 


X. THE SINGLE GIMBAL GyRO—THE Rotor” 


In Part 2, Section V1, the stabilization of a controlled 
member with a two-gimbal mount was analyzed on the 
basis of the “on-mount” stabilization concept; implicit 
in the analysis is the existence of two rate gyros at- 
tached to the controlled member, one to measure the y 
component of the angular velocity of the controlled 
member, the other the z component. Fig. 17 shows the 
space flow diagram associated with the controlled 
member and the gyro gimbals. S, is a coordinate set 
attached to the controlled member, and it is presumed 
that the angular rate of S, with respect to S;, the New- 
tonian reference frame, may be expressed as 


Wet 
W iat as W. 
WwW, 


S. is a coordinate set attached to the gimbal of the 
gyro used to measure the y component (elevation) of the 
angular velocity of the controlled member and |S; is a 
coordinate set attached to the gimbal of the gyro meas- 
uring the z component (traverse). Both S, and S; are 
rotated about an axis parallel to x,, the controlled line 
of the controlled member. S, is rotated through the angle 
Ge and S; is rotated through the angle Gt. 

Only the elevation gyro (measuring the y component 
of the controlled member’s angular velocity) is analyzed 
here. The traverse gyro differs from the elevation only 


41 Tbid., p. 150. 

42 Frequently called the single degree of freedom gyro by some 
American writers. However, since the gyro wheel turns with respect 
to the gimbal, albeit at a constant rate, some writers (e.g., see Wie JAN 
Pavlov, “Aviation gyroscope instruments,” Moscow, 1954; translated 
by ATIC, Wright-Patterson AFB, Ohio, available as ASTIA Docu- 
ment AD12226, 12227, and 12228) refer to the single gimbal gyro asa 
two degree of freedom gyro; to avoid confusion the term “single 


_ gimbal gyro” is used here. 


> 


in that its spin axis is directed along the y axis of Su, 
whereas the spin axis of the elevation gyro is directed 
along the z axis of S,. Therefore, the analysis of the 
traverse gyro follows the same form as that of the ele- 
vation gyro which is presented here; indeed, once the 
equations describing the performance of the elevation 
gyro have been found, similar equations for the traverse 
gyro may be written by inspection. 

The single gimbal gyro consists of two moving parts: 
the gimbal, which rotates with respect to the case (the 
controlled member), and the gyro rotor which is sup- 
ported by the gimbal. Following the usual practice of 
mechanical analysis, each of these elements will be con- 
sidered in turn as a free body. Applying Newton’s sec- 
ond law first to the gyro rotor, or wheel, we have 


M,° —— DH? = DSW ae) (127) 


where the superscript e indicates that the vectors are to 
be expressed in S,, the Cartesian set attached to the ele- 
vation gyro gimbal. The operator D;,( ) indicates that 
we seek the time rate of change of H, with respect to 
inertial space. H, is the angular momentum of the rotor, 
equal to J,W,, where J, is the inertia tensor of the rotor, 
and W,, is the angular velocity of the rotor (S,) with 
respect to the Newtonian or inertial frame (.S;). MW, rep- 
resents the torque applied to the rotor by the gimbal, 
which may be written as 


Me? 
M,¢ =| M,,¢ |. (128) 


e 
Vz 


Reference to Fig. 18, which is a line diagram of the single 
gimbal gyro, shows that M,.° and M,,° are applied to 
the rotor by the gimbal bearings. M,.° is the torque ap- 
plied by the rotor motor, which must overcome the 


Fig. 17—Space flow diagram—two single-gimbal gyros. 
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Fig. 18—Single-gimbal gyro (elevation). 
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friction and windage of the rotor, which need not be 
considered at this time. 

The inertia tensor of the rotor, or gyro wheel, may be 
expressed as 


0 0 
ir 
Ome 


J 
J, =1.0 (129) 
0 
Because the gyro rotor is a body of revolution, formed 
by the rotation about the g axis, it follows from the defi- 
nitions given with (126) that Jzz=Jy =J. That is, since 
Jux=fa2+2)dm, and since, by rotation, x=y, 
Jon = {3(x2+22)dm =Jyy. The rotor axis is a principal 
axis, so that the products of inertia vanish.* This can 
be seen by noting first that the body is symmetric with 
respect to the z axis; then, in each of the product of 
inertia terms, if one of the variables is considered fixed, 
there is both a positive and a negative value of either the 
x or y terms. Therefore, integrating over the body yields 
a net value of zero. The rotor is spinning about its g or 
spin axis, so the J., term is designated as Jey. 
The vector W;,° may be written as 
Wire = Wia® + Wace + Wer’ (130) 
where Wia is the angular velocity of S, with respect to 
Si, Wae is the angular velocity of S, with respect to Sa, 
and W,, is the angular velocity of S,, with respect to S.. 
Or, literally, Wia is the angular rate of the controlled 
member, designated by S,, with respect to the New- 
tonian frame, designated by \S;, etc. 
The three terms of (130) may each be expanded as 
follows: 


1 0 0 Wet 
Woe = DW at = | 0 cosGe_ sin Ge W. 
0 —smnGe cosGE W; 
Wer Wi 
= W.cosGe+W,sinGe| =| W, (131) 
—W-.sin Ge+ W; cos Ge Ws 


where Worx, W., and W; represent the components of 
Wa in Sq about the controlled line, the elevation axis, 
and the traverse axis, respectively, and W;, Ws, and W3 
represent the x, y, and z components, respectively, of 
W ia in S., the coordinates which are attached to the ele- 
vation gyro gimbal. 


Also, 


(132) 


43 Goldstein, op. cit., pp. 149-156. 
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That is, the angular rate of the elevation gyro gimbal 
(S.) with respect to the controlled member (S.) is 
directed along the x, x, axis, with the magnitude DGe. ’ 

Lastly, 


(133) 


where w=w,, the constant angular rate of the gyro rotor, 
directed along the 2, 2, axis. 

The right-hand side of (127) can be expanded as 
follows by the use of the law of Coriolis (Part 2, 


Appendix II): 
Di(IW ir?) = D,(JI-W ir?) SF W in? x JW sr). (134) 


Since J, is invariant when viewed from ,, D,J,=0, and 
the first term on the right-hand side of (134) becomes 


D.(F,W ie?) = J,(D,W ix*) (135) 
and 
DW = DiWir? + Writ X Wie? = DiWix*, (136) 
(136) can be evaluated by noting that 
Di(Wir?) = Di(TcaW ia®) + DeWar? + Wie? X War’. (137) 


Each of these expressions can be expanded as follows: 


~ DT eaW io®) = D(Tea)W ia® + Tea Di(W in*) 


0 0 0 Wet 
= DGe| 0 —sinGe cosGe|| W. 
0, —cos Ge —sin Ge W; 
1 0 0 Act 
Seino) cosGe_ sin Ge A. 
QO —sinGe cosGE || A; 
A, 
=| A2o+ DGe(W3) (138) 
A; — DGe(W2) 


where, following the notation used in (131), Ac¢z, Ae, and 
A, are the components of the angular acceleration of the 
controlled member in S,, and A,, 49, and A; are the com- 
ponents of angular acceleration of the controlled mem- 
ber in S,. That is, d1=Acr, d2 =A. cos Ge+ A; sin Ge, 
and A;= —A, sin Ge+ A; cos Ge.“ 

Also, the next term in (137) may be written as 


DGe D°Ge 
DW art = D 0 = 0 (139) 
w 0 


“4 See (121)-(123), Part 2, Appendix II, for typical forms for 


Act, Ac, and Aj. 
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(Note that Dw =0 because the synchronous rotor motor 
acts to keep w=constant.) Lastly, the third term in 
(137) may be expanded as follows: 


W,+ DGe 
Ws 
W3 w 


Wie’ x War’ = 


w(W») 
=| DGe(W;) — w(Wi+ DGe) 
— DGe(W») 


(140) 


Eqs. (138)—(140) may be substituted into (137) to give 
D.(W :,°) 3 Air? 


A, + D°’Ge+ wW>, 
=| A,+ 2DGe(W;3) — w(Wi+ DGe) 
A3 — 2DGe(W2) 


(137a) 


where A;,’ is the angular acceleration of the gyro rotor 
with respect to inertial space, expressed in gimbal co- 
ordinates. Multiplying (137a) by J, gives the first term 
on the right-hand side of (134), as follows: 


J[Ai + D°Ge + w(W2)| 
J[A.+ 2DGe(W;) — w(W1+ DGe)| 
Jap| As — 2DGe(W2)| 


(141) 


The second term on the right-hand side of (134) may 
be written 


Wr" x (J wW ir’) 


W,-+ DGe Due EG W1+ DGe 
=> W2 yA 0 Af 0 We 
W3;3+w eee Jen W3-+ w 


Sep 7 JI)WiWs a w) 
=| J —Jep)(Wi+ DGe)(W3 + w) |. 
(J — J)\(Wi+ DGe)W» 


(142) 


Therefore, (141) and (142) may be combined to evaluate 
(134), which may be equated to (128), giving 


= Di(J,W i’) = 
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where Hip =Jepw. 

Eq. (128a) relates the moments applied to the gyro 
wheel to its angular motion. Before proceeding to a de- 
scription of the motion of the gimbal, it is of interest to 
consider a simplified form of (128a). Note that 


JI(W1+ DGe) 
IW 
Tap(W3 + w) 


peu = TW in? = 


Sf 
jas (Wy + DGe) 


sp 


= H,, (143) 


In a practical gyroscope, w is a large number, so that 
W3/w<1, and J/H,,—0. Then (143) may be written 


Ge = Jae (143a) 
Eq. (128) may be expanded as follows: 
M,° 4 DH? = Di Bye == W ix? x Hy 
W,+ DGe 0 
=0O+ We Xe nO 
W;3 + Ww 
W2 
= H.»| —(Wi-+ DGe) (128b) 
0 


Only the x component of (128a) or (128b) is of in- 
terest to us in this discussion. It follows from the dia- 
gram of the gyro (Fig. 18) that the x axis of the gimbal 
is the “output” axis; that is, the motion of the gimbal 
about that axis is measurable, and, as is shown below, 
this measurement is useful as a control signal in the 
geometric stabilization systems described in Part 2. 
M,.° is the torque which the gimbal applies to the rotor; 
therefore, the reaction torque that the rotor applies to 


J(A, + D?Ge) + Sep — J)W2W3 + HepW2 
J(A2 = 2 DGeW 3) + (Gp ad J sp)W3(Wi + DGe) + H.,(W 1 DGe) 


(128a) 
TesAGee2 DGS) 
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the gimbal, ,, is equal and opposite to M,.°, and it 
follows that 


UM, = — Mi? = JA + DG) — Un STW: 
ai H spW 2 


I 


= He Eze + D°Ge) 


Tee 
os w(t a w,(—=—))| (1442) 


=~ — H,,W,= — H,,(W.cosGe+ W;sinGe) (144b) 


since J/H.,—0 and W3/w<1. 

The next section considers how this torque and other 
torques applied to the gyro gimbal affect the motion of 
the gimbal. 


XI. THE SINGLE GIMBAL GyRO—GIMBAL MOTION 


Applying Newton’s second law to the elevation gyro 
gimbal, we have 


MDH = DAS Wa) (145) 
where, as before, the superscript e indicates that the 
vectors are to be evaluated in terms of their components 
in S., which is the coordinate set attached to the eleva- 
tion gyro gimbal. M, is the vector sum of all the mo- 
ments applied to the elevation gyro gimbal, J, is the 
inertia tensor of the elevation gyro gimbal, and W,, is 
the angular rate of the gimbal (S,.) with respect to the 
inertial frame (.S;). 

Consider first the moment vector. M.¢ may be ex- 
panded as 


Me i, — CDGe — KGe 
ae 
M ..° 


Me = (146) 


M, is the control torque applied to the gimbal. M, is the 
gyroscopic torque applied to the gimbal by the spinning 
gyro rotor, which has been developed in the previous 
section. C isa damping constant and CDGe is the damp- 
ing torque generated by relative motion between the 
gyro gimbal and its case, which is fixed to the controlled 
member. K is a spring constant, and KGe isa restraining 
torque generated by the deflection of the gimbal with 
respect to the case. M.,° and M,.’ are the restraining 
torques developed by the gimbal support bearings. 

The inertia tensor for the gimbal, which appears in 
(145), may be written as 


Je OeaG 
Terme Oa eee 0 (147) 
Oza Olid, 


in which, by arguments similar to those used above in 
the discussion of the gyro rotor, the products of inertia 
vanish because of the symmetry of the gimbal. 
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Proceeding as before, the right-hand side of (145) may 
be expanded as follows: 


DiT Wie’) = De(TeWie’) + Wie® X (JeWie®). (148) © 


D,(J.W.°) is written in this form so that the vector can 
be expanded in terms of its components, all of which 
represent measurable quantities. Eq. (148) represents an 
application of the law of Coriolis, and it may be recalled 
that D.J.=0. Therefore, the first term on the right-hand 
side of (148) becomes 


DAIL) = I DAW. (149) 
But we may observe that 
D.(W ic®) =D3(W ic?) + Wie’ X Week 
= DAW 2°) =A (150) 


where A;, is the angular acceleration of S, with respect 
to S;. Eq. (150) can be evaluated in terms of its S, com- 
ponents as shown in Section X (see also Part 2, Ap- 
pendix IT) to give 


A,+ DGE | 
Aiee =| Ao+2DGeW; (150a) 
A; — 2DGeW2 
so that (149) becomes 
F(A; + D?Ge) 
J Aiee =| Jy(Ao+ 2DGeW3) (151) 
J(A3 — 2DGeW2) 
The second term of (148) is given by 
Wi+ DGe J.(W1 + DGe) 
W. x Jy(We) 
W2 JA(Ws) 
J. — Jy)(W2Ws3) 
= | J2—J2)(Wa)(Wi + DGe) | ~ (152) 
(Jy — Jz)(W2)(W1 + DGe) 
so that (145) becomes 
"| Jel Ait DIG) EU. J) Was 
=| Jy+(2DGeW2)+(J2—-J.)W3(Wit DGe) |. (145a) 


J{As—2DGeW3) + Jy —Ja) W.(Wi+ DGe) 


Only the x component of (145a)* is of interest here be- 


cause the output of the gyro is the rotation Ge about x,; 
therefore, 


* It should be observed that the torques M@,» and M, are couples 
produced by the gimbal bearings. The radial forces on the bearings 
associated with these couples also produce frictional torques about 
xe. These effects are not considered here; for further information on 
the magnitudes of these torques and other aberrations, see H. E. 
Soland, “Floated Gyro Application Notes No. 4,” Minneapolis-Honey- 
well Regulator Co., Minneapolis, Minn., “Aero Document U- 
ED9749; 1955. 
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M,.+ M,— CDGe — KGe 


= JtAy + D’Ge) J, —J,)WiWs. (153) 

Eq. (153) is the basic differential equation which de- 
scribes the operation of the rate gyro. From this equa- 
tion the operation of the integrating rate gyro can also 
be deduced, since the integrating rate gyro is a special 
case of the rate gyro for which 


eed cs Ka): 


These relations are considered in more detail in the fol- 
lowing section, along with a discussion of the errors as- 
sociated with the operation of the rate and integrating 
rate gyros. 


XII. THE RATE Gyro 


Consider first the rearrangement of (153) where the 
gyroscopic rotor torque as given by (144a) has been 
substituted for M,: 


fie J) Ge CDGe-+ KGe 
MI He Wee J.) AG 


— [Jz + Jen) — Jy +J)|W.Ws. — (154a) 
Using (144b) instead of (144a), (153) reduces to 
J,D°Ge + CDGe + KGe = M, — HipWo4+JeA1 
— (Iz — Jy) WoW. (154b) 


Eqs. (154a) and (154b) have the same form, but it is 
clear, by comparing their left-hand sides, that the usual 
gyro torque approximation, as represented by (144b), 
results in some error in the evaluation of the dynamic 
characteristics of the gyro. That is, (154b) considers 
only the inertia of the gimbal, and neglects the inertia 
of the gyro rotor. Therefore, we shall continue, in this 
discussion, to use the more exact expression given by 
(154a). 
Substituting for 41, Ws, and W3, (154a) becomes 


T,D°*Ge + CDGe + KGe 


— M. a HW, fe Ey Se EF» = E3 =f Ey (155) 


where Fy, Eo, E3, and /, are error quantities, defined as 
follows: 


E, = H.,W.(1 — cos Ge) 

E, = — H,,W-. sin Ge 

Vip J,A cL 

E, = J. — Jy)(—W.- sin Ge + Wt cos Ge) 
-(W.cos Ge + W,;sin Ge) 


and 
Ie=Je+J 
Jg= Ig +I 
Je = Ji Jen 
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In a base motion isolation system, the output of the 
gyro is the gimbal deflection angle Ge, suitably measured 
by an electrical pick-off device. This electrical signal is 
applied to a servo which controls W, in such a way that 
W.=M,/Hsp. Therefore, neglecting errors, Ge ap- 
proaches zero in the steady state. Therefore, ZH; and FE» 
are very small and approach zero in the steady state. 

Two effects tend to minimize Es: in the first place, 
J z/HepKW., and in the second place, for a three-gimbal 
mount, 4¢,—0 in the steady state. 

As has been shown, Ge goes to zero in the steady state, 
so that Ex~(J,—J,) W.W;; for Hep large, as occurs ina 
practical gyroscope, (J.—J,) W:/Hsp<1, so that E,, also, 
can be neglected. 

Consider next that K=0. Then, neglecting the error 
terms, (155) becomes 


K; 
e = —————-_ (W.. — W.) (156) 
D(TD + 1) 
where 

K,=integrating gyro sensitivity 

=a C, 
T =integrating gyro time constant 

aie 

W.=command rate 
== Me) Hs: 


The definition W.= M./ Hg» illustrates the relationships 
between the torque applied to the gyro, its angular rate, 
and the angular momentum of the gyro. Also, as can be 
seen from (156), this definition shows how the torque- 
summing nature of the gyro gimbal is used to compare 
the controlled angular velocity (in this case, W.), with 
the commanded angular velocity, We. 

For a conventional rate gyro, KAO, and neglecting 
errors, (156) becomes 


K, 


Ge = — (W. — We) (157) 


ee eer 
Pere 


n n 


K, = rate gyro sensitivity” = H,,/K, 
W, = rate gyro undamped natural frequency = A) Kus 


G 
= rate o damping coefficient = ————— 
f= tate gyr ping WTKR’ 
M. 
W.= 
Hs 


Several observations can be made concerning (156) 
and (157). First of all, the transfer function for a con- 


46 In a practical application, the volts/radian sensitivity of the 
pick-off device must be included with K; and K,. 
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ventional rate gyro consists of a constant over a second- 
order lag. The transfer function for an integrating gyro 
consists of a constant over the product of a first-order 
lag and an integration stage. It is this integration stage 
which is of such great importance in the design of 
stabilization systems, because of its effect on the reduc- 
tion of forced errors in the stabilization loop. 

Further, it may be noted that the output of both the 
rate and integrating rate gyros is proportional to the 
difference between the command quantity W, and the 
output or measured quantity W,. Thus the gyro may 
be used as an error detection device; this property is not 
commonly used on ordinary rate gyros, but it is very 
useful in instrumenting the computations required-in 
fire control and inertial navigation systems. 


XIII. THe Two-GimBat Gyro” 


The characteristics of two-gimbal gyros have been 
described extensively elsewhere;*® however, a brief de- 
scription of these devices is given here to demonstrate 
certain characteristics of those gyros which make them 
so useful for stabilization systems. 

‘Fig. 19 shows a space flow diagram which describes 
the gimbal arrangements associated with the vertical 
gyro and the directional gyro. Fig. 20 is a line diagram 
illustrating the gimbal arrangement of the vertical gyro, 
and Fig. 21 is a line diagram showing the gimbal ar- 
rangement of the directional gyro. Note that the spin 
axis of the vertical gyro rotor is vertical, and that of the 
directional gyro rotor is horizontal. We shall examine 
the behavior of each of these two gyros in the following 
manner. Let the correct or ideal orientation of the gyro 
rotor spin axis represent a “line of sight” (ZS). Let the 
actual orientation represent a “tracking line” (7Z). 
Next, consider the rotation of the gimbal axes required 
to align the tracking line with the line of sight for vari- 
ous platform Euler angles; finally, we shall determine 
the significance of these gimbal deflections as signals use- 
ful for controlling the attitude of some platform in 
inertial space. 

Referring now to Fig. 19, S; represents the inertial 
reference frame. H, R, and P are the three Euler angles 
which specify the attitude of the platform, S,, with re- 
spect to S;. The symbols S, and S, represent auxiliary 
sets of coordinates. The gyro spin axes are referred to 
Sa by the symbols S.z,, Gzy, where the S’s represent co- 
ordinate frames attached to the two gimbals and the 
G’s represent the angles through which the gimbals ro- 


47 Following a note by R. C. Webber. 

481, Becker, “Gyro pickoff indications at arbitrary plane atti- 
tudes,” J. Aeronaut. Sciences, vol. 18, pp. 718-724; November, 1951. 

M. S. Abzug, “Application of matrix operators for the kine- 
matics of airplane motion,” J. Aeronaut. Sciences, vol. 23, pp. 679- 
684; July, 1956, and Pavloy, op. cit., footnote 42, chs. 1, 3, 4. 
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Fig. 19—Space flow diagram—vertical and directional gyros. 
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Fig. 20—Vertical gyro. 
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Fig, 21—Directional gyro. 


tate. The subscripts associated with S and G are defined 
as follows: 


. for outer gimbal 


x= 
7 for inner gimbal 
fe for vertical gyro 
4 d for directional gyro. 


Consider first the line of sight vector associated with 
the vertical gyro. Let the-vector be represented by the 
symbol LS,, and in S; the components of the vector are 
given by 


I5,* = 


ea Oo © 


Also, let the tracking line be represented by TL,, and 
in Siz 


0 
TE 20 (158) 
1 


— 
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Now, we desire that 


TEA LLS. (158) 
or 
0 | 0 | 
TL,” =| 0 | =Tw-:| 0 | = LS,” (158a) 
1 1 


where 7;;,_; is the transformation matrix which trans- 
forms LS, from S; to Six. From Part 2, Appendix I, we 
know that 7;,_; has the following characteristics: 


Qy1 ae 0) 
i Rea = By Bs 0 
OO asl 


from which we may determine the relationships be- 
tween G,,, G;, and H, P, and R so that behavior of the 
vertical gyro can be determined. 

We note that 


cosH sinH 0O 
Tn =| —sinH cosH QO 
0 0 1 
so that 
0 
[EN IN SR 8 8) (159) 
1 
Also, 
£0S.)-—-)) — sin 
dS Vg 0 
snP QO cos P 
so that 
SH als 
=sin P 
= 0 
cos P 
and 
1 0 0 
To =| 0 cosR sin R 
0 -—sin R coskR 
giving 
LS Ths 
—sin P Bs 
=| sin RcosP | = | yp (160) 


cos R cos P Lis 
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That is, the unit vector LS, when expressed in its S, or 
platform coordinates, has the following components: 


Oper SI 


= Sua IR Gos JP 


<= 
cS) 
| 


Zp = cos KRcos P. 


It is interesting to observe that at every transformation 
step, the magnitude of the vector remains unchanged, 
as can be seen by writing 


| LS | = Xp" Vp Bp” 
= sin? P + cos? P(sin? R + cos? R) 
==" 17 
Now, since 
1 0 0 
Tyee 0 COS'Geo. SIGss 15 
OF — Sinn pie COSiCr sg 
it follows that 
Xp 
Waa ea Sa Se 
2p 
Xp Xov 
= 5 COS. Gon Se Sl Gen alan (161) 
—=)5 SIMGeg-1 on COS Gog aoe 


Since the rotation G;, occurs about the common Yo», Vi» 
axis, the y;, component of LS, must be equal to the y,, 
component. But if ZS,=TL,, yi must be zero [see 
(158a) |. Therefore, 


Gov = tan7"(—yp/Zp). (162) 
Substituting from (160) for y, and zy gives 
Go = tan—!(—tan R) 
or 
elit A973 (162a) 
Therefore, (161) becomes 
Sine 
LSet 0 (161a) 
cos P 
and, since 
cosGi, 0 —sinGiy 
Liewsaoe — 0 il 0) ) 
Sin’ Gan 0 COs Grip 
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it follows that 
DS = ee OE: 
—sin P cos Gj, — cos P sin Giz 
= 0 
—sin P sinG,;, + cos P cos Gi, 


(163) 


Therefore, if (158a) is to be satisfied, it follows that 


Ga = >. P3 (164) 
that is, the inner and outer gimbal angles of the vertical 
gyro are equal and opposite to the pitch and roll angles 
of the platform, respectively. This result may be antici- 
pated by reference to the space-flow diagram (Fig. 19) 
wherein it can be seen that the vertical gyro gimbal 
angles G,, and G;, “unwind” the platform rotation 
angles R and P, since Go», like R, is about a common x 
axis, and Gi, like P, is about a common y axis. 

The procedure in the case of the directional gyro is 
much the same, except that the line of sight vector is 
given by 


and we desire that 


LS q*4 


(165) 


or 


Pia = 0) Bo (165a) 


0 Ye 


Bs 
Y3 
Proceeding as before, we note that 


cos H cos P 
LS = —sin HcosR-+ sin Rcos A sin P 
sin H sin R+ cos Hsin Pcos Rk 


(166) 
Further, 


sin Gea 0 
=|—sin Gea cosGe.g 0 
0 0 1 
cosG;q 0 

= 0 1 0 
sin Gia~2 


cos Goa 
TA wih 


—sin Gia 
(hee 


cos Gia 
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so that 
Xp COS Gea wp sil! Gog | %oa 
LS 4° = |—2p Sin Goa + Vp COS Goa =| Voa (167) 
Zp | Zod 


Since yoa=Yia, and y;q must equal zero, it follows from 


(165) that 


Gap = tale I) Se): (168) 
Substituting from (166), we have 
sin R cos H sin P — sin HcosR 
Gea ane - (168a) 
cos H cos P 
It can be seen from (168a) that for R= P=0, 
Goa aa Ets Jats (169) 


that is, if the platform, as designated by Sy, is not 

pitched or rolled, then the directional gyro indicates the 
heading HT of the platform. When P and K are not zezo, 
there is an error involved in the measurement of H. Let 
this error be defined as (H —G,.) ; then Fig. 22 shows the 
range of this heading error for P and R in the regions 


O<eP ar/4 
O< R < 7/9. 


In some situations it is necessary to measure H pre- 
cisely, independent of the values of P and R. The dis- 
cussion on coordinate converters presented in Part 1 
suggests how this may be done. In qualitative terms, the 
design procedure for such a coordinate converter may 
be stated as follows: 


1) From (168a) and (169), we see that for R= P=0, 
Goa= —H. Therefore, we may consider G,4 as the 
input to our coordinate converter, and H as the 
output, with R and P as disturbances. 

Given the unit vector LSz, we see from the space 
flow diagram (Fig. 19) and 7ya_¢ that if y.4=0, 
then the proper relation between H and Gy,a is 
satisfied independent of R and P.*° 

From 1) and 2) we see that the unit vector LS, 
successively transformed through H, P, R, and 
Goa has a zero magnitude y,¢g component. There- 
fore, if P and R, obtained from a vertical gyro, 
and G,a, obtained from a directional gyro, are used 
to drive resolvers, H may be generated by using 
Yor as the error voltage driving a servo which 
positions an Hf resolver; when the servo is in equi- 
librium, 7.e., when y,a=0, (168a) is satisfied. Fig. 
23 shows the block diagram for this system. 


2) 


3) 


*° Except, as can be seen from (168a), if P—/2, in which case 
Goa—/2, independent of H, or if 


H = tan“! (tan R sin P) 


in which case G.a—0, independent of H. We will disregard these 
trigonometric singularities since they are not necessary for the present 
discussion. 
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Fig. 22—Heading error (H—G,a) as a function of H, P, and R. 
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Fig. 23—Heading angle computer. 


Examination of the trade literature and technical 
publications on gyroscopes®® reveals many interesting 
gyro configurations. All of them can be analyzed with 
the same tools that have been used here, for fun and 
profit. The use of a concise vector algebra permits not 
only the detailed examination of gyro kinetics, as de- 
scribed in the case of the single gimbal gyro in Sections 
X-XII, but also the more elementary examination of 
the functions of the two gimbal gyros as presented in 
the present section. Of special current interest is the 
operation of gyro-stabilized platforms as the basic 
mechanism in missile guidance systems. It should be 
observed that the three gimbal platforms described in 
Part 2, Section VII, is just such a device. This three- 
axis platform is presented as an extension of the two-axis 
platform used for stabilizing a line in space. Therefore 
there is a direct analogy between the two-axis platform 
described in Part 2 and the two gimbal gyros of the 
present section, since both maintain the orientation of 
line in space. As described in Part 2, however, the three- 
axis platform maintains the orientation of a plane in 
space. Thus, it can be seen that by mounting three single 
gimbal gyros on a three-axis platform, we achieve a 


50 See especially Pavlov, op. cit., footnote 42, ch. 8. 
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three gimbal, synthetic “gyro” capable of measuring the 
attitude of a body in space. Note, also, that this syn- 
thetic gyro performs the same function of the vertical 
and directional gyros described in this section when the 
two latter devices are combined with a coordinate con- 
verter as shown in Fig. 23. 

Finally, in the design of such a platform, the kinetic 
behavior of the device is of considerable interest. Al- 
though the detailed dynamic performance of such a de- 
vice is beyond the scope of the present paper, the vector 
algebra used in Sections X—XII can be extended to the 
additional supporting gimbals of the platform by suc- 
cessive application of the free body principle. Since the 
number of supporting gimbals may vary between one 
and four or more (corresponding, for example, to a two- 
gimbal gyro, or a four-gimbal stable platform), it is 
clear that the need for an orderly approach to the prob- 
lem is considerable. In such analyses, note how the 
space flow diagram itself serves to organize the study 
and establish the necessary depth of symbology. Then, 
given the space flow diagram, it is relatively easy, al- 
though tedious, to write the vector equations of the 
form given by (124) and expand these equations in 
terms of the measurable physical quantities which de- 
scribe the dynamic behavior of the control system. 


XIV. THe ACCELEROMETER?! 


For the final application of our vector algebra, con- 
sider the equations which describe the dynamic be- 
havior of an accelerometer. Like the gyroscope, the 
dynamic behavior of the accelerometer is also described 
by Newton’s Second Law. However, in this case we must 
deal with Newton’s Second Law for a translational sys- 
tem rather than for a rotational system. 

The previous examples have dealt with problems in- 
volving rotation, and the space flow diagram has been 
used as a simple device for organizing the steps associ- 
ated with the solution of these problems. 

In Part 1, the space flow diagram was presented as a 
formal device for depicting a three-dimensional dia- 
gram. Symbols were introduced which described sets of 
coordinates, angular rotations, and the axes about 
which these rotations occured. As a corollary of this 
formal usage, it was demonstrated that the space flow 
diagram suggested the order and functions of resolvers 
in coordinate converters. In addition, the space flow 
diagram was used to establish notational requirements 
and to organize the operational steps necessary to solve 
several types of vector equations. It is the latter char- 
acteristics which we wish to extend in the present sec- 
tion to problems in translation motion, as opposed to 
the rotary motion considered in the previous sections. 
For example, consider the space flow diagram and vector 
diagram shown in Figs. 24 and 25, respectively. The 


51 After W. Wrigley, R. B. Woodbury, and J. Hovorka, “Inertial 
Guidance,” Institute of Aeronautical Sciences, New York, N. Y., 
paper FF-16; 1957. 


IRE TRANSACTIONS 


Fig. 24—Space flow diagram—accelerometer. 
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Fig. 25—Vector diagram—accelerometer. 


mass element of the accelerometer is located in inertial 
space by the vector Rr, shown in Fig. 25. Also, it is 
located with respect to the accelerometer case by the 
vector R,., which in turn is located with respect to the 
center of mass of an aircraft, for example, by the vector 
Ra. etc., as shown in Fig. 25. 

The positions in the vector diagram labelled J, 
E, etc., in Fig. 25 represent a series of Cartesian co- 
ordinates designated S;, Sz, etc. These Cartesian sets 
may then be defined as follows: 


Sr;=an arbitrary Newtonian frame, 

Sy=a frame located at the center of the earth, 

So =a frame located at a point moving in orbit about 
the earth, 

S4 =a frame fixed to the vehicle center of mass, 

S, =a frame fixed to the accelerometer, 

S,=a frame fixed to the mass element of the accler- 
ometer. 


Then, from Fig. 24, it can be seen that the concept of 
the space flow diagram can be used to describe trans- 
lational systems as well as rotational systems if we drop 
the formalism introduced in Part 1 concerning angles 
and axes.” 

In the vector terms, Newton’s Second Law for a 
translational system is given by 


MoD? Rta = > Fa + ma >,Ga (170) 


where 


Ma = mass of object of a, 
Rra= position of object a with respect to inertial 
space, Sr, 
D/?Rra=acceleration of object a with respect to iner- 
tial space, 
>°>F,=sum of nonfield forces acting on object a, 
>G, =sum of field forces acting on object a. 


® The formalism can in fact be extended to include both rota- 
tional and translational systems. However, this extension is not re- 
quired for the present discussion. 
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Then, for a typical accelerometer system, 
meDr Rre = k Rae — CD Kae 


+ m(Gre+ Gare + Gse+ ee -)/ (171) 


where 
m,=mass of accelerometer element, 
k=spring constant, 
R,. = deflection of accelerometer mass with 
respect to-the case, 
c=damping constant, 
D,Roe= velocity of mass element with respect 
to accelerometer case, 
Gre, Gue, Gse=gravitational fields at mass element 
due to earth, moon, and sun, respec- 
tively. 


From Figs. 24 and 25, we note that 


Rre = Rta =a Ree (172) 
so that, applying the law of Coriolis, we get 
Dr Rre = Dr Rta a Dire == Wa x Fibs (173) 


Differentiating again gives 
DP Rre = Dy? Ria + Da? Rae + 2Wia X Da Rac 

(DW ta) X Ree W ta We X Race 
In addition, 


Kia = ra Raa (175) 


which can be expanded in the same fashion to give 


DrRra = DrRra + DaRaa + Wra X Raa. (176) 


The vector Raq locates the accelerometer case with re- 
spect to the center of mass of the airframe. Conse- 
sequently its time-rate of change as viewed from air- 
frame coordinates is zero; that is, 


Da Ras = 0. 


Therefore, the acceleration of the accelerometer case 
with respect to inertial space is given by 


Dr Rr = Dr? Rra + (DrWra) X Raa + Wra 


KHWaa Raa): (173) 
But from (170), 
ee [yee As es 
DP Rra = + GeatGuat+Gset+-:: (178) 
MA 
where 


ma =airframe mass, 
> F.4=sum of nonfield forces on airframe, 
Gra, Gua, Gsa=gravitational fields of earth, moon, 
and sun at airframe. 


The substitution of (174), (177) and 
(178) into (171) gives 
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ae = Tae 

W,, Wn ) 
Dara ire a, 28 = 

as W2 (Gue — Gza + Gye — Gua 


maW 7 


+ Gse— Gsa + +--+) 


[Waa X (Wa X Rac) + (DrW1a) X Raa 


W,2 
+ Wia X (Wia X Rae) + 2Wia X (DaRae) 
+ (DrWra) X Rae (179) 
where 
W, = accelerometer undamped natural frequency 
= Vk/Me, 
£ = accelerometer damping coefficient = 


2\/m-k 

The following observations may be made concerning 
(179): 

1) The displacement vector R,. represents the ac- 
celerometer output; in general, it is desired that 


jie Nit! dF a/ma; 


that is, that the accelerometer measures the nonfield 
forces acting on the airframe. 

2) In order that Rae~ >> Fa/ma, it is desirable that 
Wy be large. Wy large means that the instrument has 
good dynamic sensitivity; however, as can be seen from 
the right-hand side of (179), increasing Wy decreases 
the static sensitivity of the instrument. 

3) Note that the terms in brackets are of two types, 
those containing R4,, and those containing Ry. The 
terms containing R4, represent errors due to the fact 
that the accelerometer case is not located at the air- 
frame center of mass. The R,, terms represent errors due 
to the deflection of the mass element supports. Since 


Wa = Wla = Waa = Wr 


if follows that errors due to R,, will be at least an order 
of magnitude smaller than these due to the acceler- 
ometer not being placed at the center of mass of the air- 
craft. 

4) If the gravitational fields are considered to have 
negligible gradients over the volume of the airframe, 


then 
Gr, + Guet Geet °* = Gea t+ Gua + Gra t <<; 


that is, since 


wae 

BA a 

| GEe| ~ 
Rae? 
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and since Ree=Rzatr, with Rgs>>r, it follows that 
| Gara | = | Gre = | Gra =] Gre 


~ (53 


Therefore, neglecting the second-order effects, (179) re- 
duces to 


ee 


Kae a ie p 
msaW,,.” 


(179a) 


It is convenient to relate the acceleration of the air- 
craft toa Newtonian frame centered at the earth, rather 
than the arbitrary set of inertial coordinates indicated 
by (179). To do this, note that 


Rra = Rin + Raa. (180) 
Eq. (170), when applied to the earth, yields 
D? Rre = Gue + Gsn +: --. (181) 


Since Wr_1, =0 (that is, the Newtonian frame centered 
at the earth is irrational with respect to S7), then 


D7? Rea = Drz?Rea. (182) 


Substituting (178) and (180)—(182) into (179) gives 


Ge) t2Gtt] 
“a Wr rs 
ee “ se = 
= [Gus — Drn? Rea + (Gua — Guz) 


We Bs rap 
+ (Gsa — Gon) +--+] 


where the terms in brackets in (179) have been dropped. 
According to Wrigley®! the gravitational difference 
terms may be dropped, showing that the acceleration 
measures the effect of the earth’s gravitational field on 
the airframe and the translational acceleration of the 
airframe with respect to a Newtonian reference at the 
earth’s center. 


(183) 


XV. CONCLUSIONS 


ae 
In this final part of a three-part series, we have ex- 


tended the use of our vector algebra to two basic instru- 
ments, the gyroscope and the accelerometer. First the 
kinetic equations of a single-gimbal gyro were deter- 
mined, using Newton’s Second Law of motion as applied 
to a rotary system. Then the characteristics of two 
common two-gimbal gyros were examined. Finally, the 
dynamic behavior of an accelerometer was considered 
briefly, thus indicating how our vector algebra may be 
extended to translational as well as rotational systems, 
and to describe kinetic as well as kinematic relations. 


58 That is, since the vectors Gza and Gz», are virtually parallel, 
the difference between their magnitudes is approximately equal to the 
magnitude of their difference, etc. 

54 Wrigley, et al., op. cit., p. 37. 
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Statistical Evaluation of Digital-Analog Systems for 
Finite Operating Time’ 


R. B. NORTHROP} anp G. W. JOHNSONT 


Summary—A frequency-domain mathematical model for com- 
paring the performance of a linear sampled-data channel to a linear 
continuous channel is developed. The model assumes a suddenly 
applied stationary random input (input identically zero before the 
local time origin). 

The model allows an explicit algebraic definition of ensemble 
mean-squared error, after a finite operating time, by application of 
residue theory. The ideal or comparison channel need not be realiz- 
able. 

The quasi-stationary characteristics of the excitation are ac- 
counted for by including a starting switch as a variable parameter 
within the appropriate system weighting functions. 

The technique developed in this paper is utilized to evaluate the 
ensemble mean-squared error due to processing a vehicle velocity 
estimate (as might be supplied by an integrating accelerometer) in 
a digital computer. The velocity estimate is used to calculate a nu- 
merical value of present vehicle position. This problem is of funda- 
mental importance in present-day pure inertial, pure Doppler, or 
inertial-Doppler navigation systems. The effect of quantization, in- 
herent in the process of analog-to-digital conversion, may be in- 
cluded in this evaluation. 

It is shown that for cases where system inputs can be approxi- 
mated by narrow-band, first-order, Markoff-type power spectra, 
the practical engineering use of the simplest digital integration pro- 
gram (rectangular) or the simplest hold (box-car) is well justified. 
The examples illustrate the mathematical techniques necessary to 
compute the ensemble mean-squared error, and illustrate how sev- 
eral simplifying assumptions may be used. 


I. INTRODUCTION 


RIOR to recent publications,!? “frequency- do- 
Prraic’ statistical studies required the assumption 

that the input characteristics be stationary for 
all time. Since all physical systems have an initiation 
time, this requires, from a practical standpoint, that the 
operating time be long compared to the system “mem- 
ory” or settling time. However, in many important 
applications, the constraint that a system be in a steady- 
state operation imposes a severe limitation. 

As pointed out by Johnson,’ the response of an “in- 
finite memory” filter (such as an integrating network) 
is in a transient state for all finite operating time, after 
sudden application of a stationary input. It is well 
known that the steady-state response of a linear, con- 
stant-parameter system due to stationary excitation is 


* Manuscript received by the PGAC, April 13, 1959; revised 
manuscript received, January 12, 1960. 

+ University of Connecticut, Storrs, Conn. 

t International Business Machines Corp., Owego, N. Y. 

1R. B. Northrop, “Statistical Model of Linear Sampled-Data 
Systems for Finite Operating Time,” M.S. thesis, University of Con- 
necticut, Storrs; 1958. 

2G. W. Johnson, “Frequency-domain statistical model of linear 
variable networks for finite operating time,” 1958 IRE NationaL 
CONVENTION RECORD, pt. 4, pp. 70-78. 


stationary. The fact that the transient response of linear 
invariant systems to suddenly applied stationary inputs 
is, in general, nonstationary is clearly demonstrated as 
follows. 

The transient response of a stationary filter to a sud- 
denly applied (or quasi-stationary) input is the response 
of an equivalent variable filter, including a starting 
switch, to an input which is assumed stationary for all 
time. Thus, it is only in the steady state, or after the 
variable effect of closing the starting switch is no longer 
detectable, that the characteristics of the response be- 
come stationary. 

It is noted that statistical analysis procedures supply 
only a measure of average or mean properties of a signal. 
In general this refers to averaging some functional 
(usually the square) of a large number of signals repre- 
senting a collection or “ensemble” of typical signals, 
subject to a given environment. Thus, the measure ob- 
tained, referred to as “ensemble average,” is an estimate 
of the expected response characteristic and does not 
necessarily define a specific measure of any one response 
signal. However, for that subclass of stationary en- 
sembles which obey the “ergodic” hypothesis an en- 
semble average is equivalent, in probability, to a cor- 
responding average over time for any one signal or en- 
semble member. Thus, many publications concerning 
steady-state statistical analyses impose the constraint 
requiring inputs to be “ergodic” in order to use the time 
average of the squared response as a measure of system 
performance. Except for a few recent publications’ all 
published statistical methods for sampled-data systems 
have required the “ergodic” constraint for application. 
It has been shown,! however, that the continuous re- 
sponse of a linear sampled data system is in general non- 
stationary, even in the steady state. However, the 
steady-state continuous response, of linear invariant 
sampled-data systems, is periodically stationary such 
that, if the inputs are ergodic, a time average over any 
one response is equivalent, in probability, to the mean 
value of all possible ensemble averages. It is noted that 
the time average obtained in this instance accounts only 
for the average properties of the intersample ripple in 
the response. In contrast, the ensemble average may 
vary markedly as a function of “phasing” of the output 


3G. W. Johnson, “Statistical analysis of sampled-data systems,” 
1957 WESCON ConveENTION REcoRD, pt. 4, pp. 187-195. 

4B. Friedland, “Least Squares Filtering and Prediction of Non- 
stationary Sampled-Data System,” presented at Conf. on Computers 
in Control Systems, Atlantic City, N. J.; October 16-18, 1957. 
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sampler, as will be noted with respect to a specific ex- 
ample later in this paper. 

In summary, the model of this paper represents the 
most general statistical model for linear sampled-data 
systems. For instance, the steady-state performance is 
obtained by letting the operating time approach in- 
finity, or, for ergodic inputs, a continuous time average 
may be obtained by taking the mean value of the non- 
stationary ensemble average over all possible phasings 
of time sampling. 


II. STATISTICAL MODEL FOR FINITE 
OPERATING TIME 


The basic error generating model is shown in Fig. 1. 


Fig. 1—Basic error generating model. 


The response of a linear sampled-data channel is com- 
pared with the response of an ideal analog channel, for 
all finite operating time, after sudden excitation by an 
additive, stationary, random signal and noise. 

It is assumed that the sampled-data channel of inter- 
est may be reduced to a pure digital filter in cascade 
with a continuous filter which in general will include 
both extrapolator-hold and analog dynamics. 

The following nomenclature and definitions are per- 
tinent to Fig. 1. 


ha(t) =weighting function of the fixed linear- 
continuous filter in the ideal or compari- 
son channel (response at time ¢ to a unit 
impulse applied att=0). Not necessarily 
physically realizable. 

g(t) =weighting function of a fixed linear con- 
tinuous filter including extrapolator-hold 
dynamics. Assumed to be realizable. 

d(nT) =number sequence weighting function of a 
fixed linear digital filter (digital filter nu- 
merical response at t=nT to a numerical 
input of “1” at f=0). Assumed to be 
realizable. 

r;(t) =jth element of the sampled-data channel 
input ensemble. 

v,(t), nj(t) =jth elements of the signal and noise en- 
: sembles, respectively. 
e,(t) =7th element of the system error ensemble. 


eo ao 
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i7r;(t) | = }9,(t) +n,(t) } =stationary ensemble for 
re(); 
(e;(t))=ensemble mean-squared error at time ¢ 
(averaged over all j). 
1-0 =starting switch which is open for <0 and 

x closed for ¢>0. 

7 =sampling switch which closes momen- 
tarily every 7 seconds and generates an 
impulse magnitude equal to the ampli- 
tude of the input signal at t=nT (equiv- 
alent to an impulse modulator’). 


With reference to Fig. 1, the ensemble mean-squared 
error may be expressed as 


(620) = (ca) — 2caDelO) + (2). A) 


It is shown in Appendix I that the three terms on the 
right-hand side of (1) may be expressed as equivalent 
complex integrals as follows: 


1 cf 
eA) == [Bley Hal s, Na (—s, Dds (2a) 
20] —joo 
eee [®..(s) Ha’ (—s, de" |F’*(e", m, p)ds (2b) 
Td —joo 
1 
ao —|{ ®,,(s)F’* (ee, m, p)F'*(e?, m, p)ds (2c) 
on] J 5 


at! 
where ®,,(s) and ®,,(s) are the spectral densities of signal 
and input, respectively, and ®,,(s) is the cross spectral 
density between signal and input. Spectral density is 
defined as follows: 

Ban(s) = fo daylserer 3) 
where ¢,(7) is the correlation function between {.x;(t) \ 
and { y,(t) } defined as 


bey(t) = (xjQys(t + 7)) (4) 


where { x;(t) \ and {yj(t-+r) \ are stationary for t>0. 

The terms H,’(s, t) and F’* (e:7, m, p) are the equiv- 
alent transfer functions of the ideal and sampled-data 
channels, respectively, including the effect of a starting 
switch as a variable parameter, where 


for 2:0; 


—(s—w) t 


1 
Hi (s, t) & Ha(s) = mae Ha(w) Sue dw. (5) 
Tj J va oo 


If H4(s) is realizable, [a encloses the poles of Ha(w) but 
excludes w=s. In the event that the comparison channel 
is not physically realizable, [4 is a closed contour taken 
in the positive sense enclosing all the poles to the left 
of the analytic strip for Ha(s) (the poles which define 
the impulse response for positive time). 

In general, the bilateral Laplace transform is used 
since ha(t) need not be physically realizable. 


5 W. K. Linvill, “Sampled-data control systems studies through 
comparison of sampling with amplitude modulation,” Trans. AIEE, 
pt. II, vol. 70, pp. 1779-1782; 1951. 
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Before defining F’*(e7, m, p) it is convenient to ex- 
press the latter two integrals in (2) in terms of the z- 
transform variable. This development is shown in Ap- 
pendix I and results in 


1 cp 
(0) = 5 { PACOH IG DEL tenes 


Td 


(6a) 


Joo 


dz 
Z|®,,(s)Ha'(—s, eT | F*(g, mM, p) hs (6b) 
Zz 


agi} 4 sh 
1 j 1 dz 
+ f BAP, m, BP (— > m ?) (60) 
Qnrj J 1 z z 
where J is the “semi-open” line segment |z =1, 


—mr+A<arg z<a+A, taken in a counter-clockwise 
sense and A is an arbitrary real number. The procedure 
for evaluating the integrals of (6) by integrating over 
equivalent closed contours will be illustrated in the next 
section with respect to specific examples. 

With reference to (6), the notation 


Z|&,,(s)Ha' (—s, te" | 


denotes the bilateral z transform of the quantity in the 
brackets, defined in terms of the “Poisson” sum as 


n=o 


1 2 
Z[®o,(5) Hal (—s, Ne" i 2, (5 + jn) 


n=—co 


2a 
i! (=s =n ra ‘ Cene nie seals) et C1) 


The term ©,,*(z) represents the sampled power spectral 
density defined in terms of the Poisson sum as 


Lo 2 
rs Dads (: + jn =). (8) 


n=—o 


®,,*(z) = 


The term F’*(z, m, p) represents the truncated, modified 
z transform of the over-all sampled-data channel, where 


F¥(a, m) = D*(2)G*(s, m) (0) 
and 
D¥(2) = y a(kT) (10) 
and 
Gram) =D gla + mo) (11) 


where m ranges 0<m <1. It is noted that this definition 
of the modified z transform differs from that given by 
Barker® and Jury’ by a factor of z-!. The authors prefer 


6 R. H. Barker, “The pulse transfer function and its application 
to sampling servo systems” Proc. IEE, vol. 99, pt. IV, pp. 302-317; 
December, 1952. 

7E. I. Jury, “Discussion of G. W. Johnson, D. P. Lindorff, and 
C. G. A. Nordling on extension of continuous-data system design 
techniques to sampled-data control systems,” Trans AIEE (A pplica- 
tions and Industry), vol. 74, pt. II, pp. 252-263; September. 1955. 


IRE TRANSACTIONS ON AUTOMATIC CONTROL 


June 


this definition since G*(z, m) approaches G*(z) as m 
approaches zero. 

F’*(z, m, p) is obtained by truncating F*(z, m) by 
means of complex convolution in 2. 


1 
TENG | Tsp ee aI ec 
20] 


F*(y,m)(z/y)? dy 


ole Gym eae 


I’, encloses the poles of F*(y, m) but excludes the point 
y=z, and p is an integer such that t=>p7-+mT, where 
OS —aAands 20) 

The expression for ensemble mean-squared error as 
given in (6) will be used in the next section to evaluate 
the relative merits of various digital integration pro- 
grams and extrapolator-hold filters. 


(12) 


III. Some ILLUSTRATIVE EXAMPLES 


As stated in the Introduction, the frequency domain 
statistical model presented in this paper is necessary to 
evaluate the performance of sampled-data systems when 
the system settling time is long compared to the oper- 
ating time [time between initial application of the sta- 
tionary random input and evaluation of the ensemble 
mean-squared error (emse) |. 

An example of such a system, of general interest, is 
any of the commonly-used digital integration programs, 
followed by some extrapolation-hold dynamics. Con- 
ventional steady-state mean-squared error (mse) analy- 
sis techniques would, for the case of infinite-memory 
digital integration programs, give rise to an unbounded 
mse. (The inversion integrals are not defined.) 

The techniques of this paper, as applied to the exam- 
ples involving digital integration below, allows evalua- 
tion of the emse for all ¢>0, and not just at the sampling 
instants. It is seen that the steady-state, or infinite oper- 
ating time emse is indeed unbounded for these examples. 

A practical application of digital integration programs 
is in the inertial guidance field. For example, a digital 
velocity measure can be integrated to obtain an estimate 
of present vehicle position. In this case, it is evident that 
system operating time must be considered to be finite. 

It is assumed that a measure of the error due to nu- 
merical integration of a random velocity signal is of 
interest. It is also assumed that the guidance interval 
is sufficiently large compared to the numerical compu- 
tational period of the integration program for the inter- 
sampling behavior of the esme to be negligible, com- 
pared to the total emse level. Thus, only the sampling 
instants will be considered in the first two examples. If 
relatively short operating times are considered, where 
the over-all level of the emse has not had time to build 
up, the intersampling behavior may not be negligible, 
and may be found by letting m vary, 0<m<1. 

The random velocity input for the following exam- 
ples is considered to be a relatively narrow-band signal, 


1960 


compared to the computational frequency, with a power 
spectral density of the form 


2acy" 
Os ale 


Using this input signal, a comparison is made between 
a general second-order digital program, rectangular 
integration, and ideal integration (1/s). The digital to 
analog conversion is accomplished by a simple “box- 
car”-hold filter. Computational delay is neglected in the 
examples (see Fig. 2). 


b,,(w) =z (13) 


if 


vj(t) t=0 


Fig. 2—Error-generating model for the first example. 


Example 1 


The first step in computing the emse for the model 
involving rectangular integration is to determine the 
truncated, modified, transfer functions of the compari- 
son and sampled-data channels. From (5), 


1 1 1 e —w)t — post 
fon See dw = (14) 
Ss LFF Bp 8 — S 
and 
wipes 
Hah — Sj t) = (15) 


In general, the truncation process converts the 
Laplace transform of a realizable filter weighting func- 
tion to an entire transcendental function (analytic in 
the finite s plane). If Hu(s) is the Laplace transform of 
a two-sided time function, then the truncation process 
converts the left-half plane portion of Ha(s) to an entire 
transcendental function, analytic in the left-half s plane. 

For the sampled data channel, 


Tz 
F*(z,m) = D*(z)G*(z,m) = mae, ae (16) 
piee 
Truncating, by use of (12), 
Tz 1 Lye a9) 2 dy 
tila ) Nh, = TF Trae 
VIE. 2-1 wdJry—1 (@/y—1) »¥ 
ss see i p> (17) 
z—1 
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pr ( 1 ?) Ihe = 2?) 
> ™, 2 SDE 18 
: eae (18) 


The emse may now be written using the three integrals 
of (6). Since the large-time behavior at sampling in- 
stants is of interest in this case, !=p7-+mT reduces to 
t=pT, where p is a positive integer. Thus, 

(e7(t)) 


9 


Oy 


1 jo 2a (esr =r, 1) (1 = e—8PT) 
i ° { 2 2 ds 
2mj —joo (a? ieee 3”) 5 S 


= aig z| 2a (es? — 1) | T(z—2-”) dz 
PAL EAE =) s Ca 

Le PG 2 (= ein ea 
J, (1) (2) (nen) ae ger 


where x=aT. 

The integrand of (19a) is seen to have finite s-plane 
poles at s=-+a, and is analytic at s=0. The path of 
integration may be modified to avoid the point s=0 
by an infinitesimal semicircular arc to either the right 
or left, and the value of (19a) will be unaltered. In this 
case, the origin will be passed to the right, defining the 
contour L (see Fig. 3). 


(19a) 


(19b) 


20 


jw 


s PLANE 


Fig. 3—Modified (equivalent) path of integration for (21a). 


The integral (19a) on the modified contour L may be 
expressed as the sum of two integrals: 


Dea 


2a 
Tr, = f[ ds 
2nj J 1 s*(a+ s)(a — 5) 


ese 


By = f F 
arj J 1s*(a +.s)(a — S) 


ys (20) 


The value of the integral for all ¢>0 is of interest. Eq. 
(20) may be evaluated by means of residue theory; the 
modified path of integration, L, may be closed by a semi- 
circular arc of infinite radius for either integral. The 
direction of this arc depends on the sign of the exponen- 
tial term in the numerator, and must be chosen so that 
the integral along the arc of closure adds nothing to the 
value of (20). It is seen that the left-hand integral in (20) 


P22 
must be closed to the left and the right-hand integral to 
the right. Application of residue theory yields 

2pT 


D, 
T, Si -= +- eh (eet — 1 
a a~ 


(21) 


The cross-term of (19b) requires the evaluation of the 
bilateral z transform of the bracketed quantity. The 
easiest way to do this is to write the bracketed quantity 


in terms of its inverse Laplace transform and use the 


definition 


n=0 


Z(H(s)] = Z[h()] = dD h(nT)z" 


u=—oO 


(22) 


where 
h(t) = £>[H(s)]. 
Thus, the cross-term may be written 
—2 ¢ 2(cosha — 1)[z? + 2 — 2°(z? + z)|T(z — z-?) 
J Geen) Zi Cnt z— set )i(e ist) 


Ty == ; 
27] 


dz 
_—- (23) 


z 
The integrand of (23) is seen to be analytic at z=-+1, 
for both factors, as a result of the truncation process. 
Since there is no pole at z= +1, the semi-open line seg- 
ment, J, may be modified to avoid the point z= +1 by 
an infinitesimal semicircular arc. The are will be chosen 
to pass to the right in this case. The modified counter, 
I’, is shown in Fig. 4. 


im [z] 


z, PLANE 


Fig. 4—Modification of the semi-open line segment, J. 


Eq. (23) may now be written as a sum of two integrals 
on the modified contour, I’. 


AT(cosh x — 1) 


2,= 


a 

1 getl + get? — (2 + 22+ 1) 

een Z 

ab (81) (gi 6-7) 228) 
1 g+1 


ee r 2°(g — 1)?%(z — e*)(z — & 


ish die(24) 


As shown in Appendix II, the modified semi-open line 
segment J’ may be closed either to make a contour- 


clockwise enclosure of the region 0 <|z| <1, or a clock- 
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wise enclosure of the region 1< | | <o, dependent on 
the exponent of zg, in order that the values of (26) are 
unaltered. Thus, the first integral in (24) encloses the 
region 0< | 2| <1, and the second integral encloses 
1<|2| <a. Application of residue theory yields 


T? 
rea 
x 
i 2(cosh « — 1)[ (et + 1)? — (e* — Le? FY] 
sink 2(@2" —=t1)- 
e—* (Pt+1) (22 + e*)2(cosh i \ 


sinh x(e* — 1)? 


(25) 


Finally, the third integral (19c) may be evaluated in a 
similar fashion as (23). The result is 


ap a = 2), = sinh 4 pee) 
(e-* — 11)? cosh « — 1 


Cae 
en Ks ait . (26) 


i 


The ensemble mean-squared error for the case of a sud- 
denly-applied stationary random input signal with a 
power spectrum of the form of (13) is the sum of (21), 
(25), and (26). This emse is valid only for sampling in- 
stants where the intersampling behavior of the emse is 
negligible compared with the over-all emse level. For 
values of p large enough to cause xp >15, terms contain- 
ing e-*? and e-*?t) are negligibly small, and may be 
dropped. Thus, the emse for the model of Fig. 2, valid 
for t=pT where-xp>15, is given by 
2 
(e*(pH)) _ rp { 


o;? 


sinh x 2 ; 


cosha — 1 a 


2(cosh x — 1)(e-* + 1)? 


x sinh x(e-* — 1)? 


of (- i all - 27) 


It is seen that (27) is linear in p. 
Example 2—A General Second-Order 
Integration Program 


+ r{( sinh x +-) 
cosh « — 1 a 


A logical next step is to consider more sophisticated 
schemes of digital integration to see if a program exists 
that will give least emse at a given large operating time. 

Fig. 5 illustrates such a general second-order approxi- 
mation to 1/s. This program is a so-called “oscillating 
program.” That is, in the steady state, the number 
sequence weighting function is 


DAE: 
c(nT) = —— (2) forevenn > 2 
r+2 


OnL) = 


Dale 
= (r) foroddn > 1. (28) 


His = 


1960 


Fig. S—Error-generating model for example 2. 


The constant 27/r+2 is chosen to cause the weight- 
ing function to oscillate about an average steady-state 
value of 1, given an input of “1” at :=0. If r=2, the 
general program reduces to trapezoidal integration. If 
r=4, the program becomes the well-known Simpson’s 
1/3 rule. Other values of r are presumed to be of interest. 

Following the methods outlined in the first example, 
the emse for this system has been calculated and found 
to be, for xp>15, 


(e?(pt)) ate { sinh « a 2 
Ger cosh x — 1 oe 
re 24 sinh x 
AG (: zs 5) - cosh x — i} cae ee 


b2(r) is also a function of x and 7, and is given by 
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The rather formidable constant given by (30) and (31) 
is found to be of the same order of magnitude as the 
constant term for rectangular integration, for ranges of 
the variables 0<x <1, 0<r<10. The # coefficient then 
is the important factor when large operating times are 
considered. 

Thus, the logical choice of integration program would 
be the rectangular one, using the least emse criterion. 
Rectangular integration is certainly the easiest to im- 
plement, and it gives performance that is as good, if not 
better, than a more complex second-order program, for 
large operating times and the input specified. 

For short operating times (xp<15), this will not 
necessarily be so, and a comparison would have to be 
made that would include exact behavior of the constant 
terms, and possibly the emse at intersampling instants. 


Example 3—Comparison of Basic 
Extrapolator—Hold Filters 


In the previous two examples, behavior of the emse 
at sampling instants only was considered, for large sys- 
tem operating times. In this example, the extrapolator- 
hold filters involved have weighting functions that are 
zero after at least two sampling periods, as compared to 
the infinite settling times involved in the first two exam- 
ples. Because of this finite settling time, the error- 
generating models shown below reach “steady-state” for 


b 2 2 sinh x 2(2 — r)sinh x Acosta ee Cae a 8 
see ee em dr 2 Pct 2) 1 ensh 2i-tcil) (r + 2) « (sinh x)(e* — 1)? (r + 2)a 
St: i + 6e-% + 1 + Ir(Qe** + rem* + | mn 4 (30) 
(r + 2)? (e*+-1)%(e* — 1)? me 
(valid for p even) 
or 
r sinh x r(r — 2) sinh x A{cosh wi— 1) |e? Iles rt] = a 
ee Ci 2—1)(r +2) (7 + 2)?%(cosh x + 1) (r + 2) x (sinh «)(e* — 1)? ie 
er Cea E + 667% + 1+ Ir(2em™™ + re + ~< (31) 
GA 2) alt 2)? Ore rath Ws © Fadia oh Oe 


(valid for p odd). 


It is evident that the rate of increase of emse given 
by the p coefficient in (29) is a minimum when r=2. 
For this case, the general second-order program reduces 
to trapezoidal integration. Moreover, it is noted that 
the rate of increase of emse for the trapezoidal integrator 
is the same as for the rectangular integrator treated in 
the first example. 


t>2T (after initial application of the stationary random 
input). 

It is seen that a great simplication results if values of 
p>2 are considered. The truncation process is no longer 
necessary, since the weighting functions of the extrapo- 
lator-hold filters are identically zero for t>2T (see 
Fig. 6). 
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EXTRAPOLATOR- 
HOLD FILTER 


(a) 
Transfer Function 
Le et 
s 
(b) 
tenes eels e-ST 
— - ue + Ts 
(c) 


(d) 


Fig. 6—(a) Basic error-generating.model for example 3. (b) Zero- 
order or box-car hold. (c) First-order hold with variable reset. (d) 
First-order hold with variable velocity correction. 


The input for these three examples is a random signal 
with a power spectral density given by (13). 


1) Considering the zero-order hold filter first, appli- 
cation of (6a), (6b), and (6e) yields 


1 2 Donap 
(e7b)) = f ds (32a) 
ier RA fos ey Ee 
1 2acv? dz 
aa JE, eal = (32b) 
jen eed Z 
8 1 fA 2acv? | dz (32c) 
— —, c 
Zi oars lad —"s 3) hee 


The first and third integrals are equal to o,?. 
z-transforming the bracketed quantity, the second 
integral may be written 


1 4o,?[z sinh (x — wm) + sinh (mx) | 


ors (g — €*)(z — e*)z 


- dz. (33) 
20] ve 


The final result, after algebraic simplification, is 


8 After J. R. Raggazzini and G. F. Franklin, “Sampled-Data 
Control Systems,” McGraw-Hill Book Co., Inc., New York, N. Y., 
pp. 40-42; 1958. 
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(e*(d)) 
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= 21 —@™) valid for? 2 I. (34) 


2) The emse for the first-order hold with variable re- 
set is found ‘to be 
CAL 
ae ={1-— Qe” |m +1+ (1-—m-— ue | 


Oy 


+ (m+ 1)? + (u — 1)2 + m(m — 2 + 2u) 
+ 2e*(1 — u — mu — m’) 
(valid for # > 27). (35) 


3) The emse for the first-order hold with variable 
velocity correction is 


(e?(t)) 


Oy 


= vAGl 22 Car) -- 21 = ca) 


-[Rk2m? + km(1 — em) | 


(valid for 7 > 27)> G6} 


It is noted that at sampling instants (m=0), the 
emse for all three holds is zero. 


Conventional mean-squared-error techniques give the 
average value of the steady-state mse over m. In the 
examples above, 

0 Sig Me 
the emse is given for all m, 0<m<1, and use of (37) al- 
lows calculation of the average mse with respect to m, 
if so desired. 

A numerical comparison has been made between the 
holds for various values of m and x. Values of wop_ and 
Ropt have been derived to minimize the emse at a given 
x and m. 


Uopt = 1 — cD 4+ (m+ 1)e* —m (38) 
ibe eetep 
Rove Sa (39) 
2m 


Figs. 7 and 8 illustrate the optimum behavior of the 
emse for various representative operating conditions. It 
is at once evident that the best choice of hold is the 
simple box-car. The hold of Fig. 6(d) gives almost iden- 
tical performance, but of course is harder to implement. 
The choice of the box-car is based on least emse for any 
values of m and x in the ranges 0<m<1, 0<x<2. For 
certain deterministic inputs, and other types of input 
power spectra, the box-car hold filter is not necessarily 
“optimum.” It is felt, however, that the example is sig- 
nificant, since a large class of random input signals are 
characterized by spectra of the form of (13) or may be 
approximated by it. 


IV. CoNCLUSION 


Using the least emse criterion as a measure of system 
performance, the preceding examples have shown that 
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Ho = zero order hold 
Hy, = variable reset hold, (u = Yopt) 


Hx, = variable velocity correction 
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Fig. 8—Variation of emse with ~. 
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for cases where system inputs can be approximated by 
narrow-band, first-order, Markoff-type spectra, the 
practical engineering use of the simplest digital inte- 
grator (rectangular) or the simplest hold (box-car) is 
well justified. 

It must be remembered that the conditions specified 
for the examples constrain the generality of the results, 
and good judgment must be used not to “over-extra- 
polate” the significance of the conclusions set forth 
above. 

The analytical technique described in this paper 
makes it possible to evaluate the performance of linear 


‘sampled-data systems subjected to suddenly applied 


random signals, stationary after the local time of origin 
and identically zero before. Using algebraic means, it is 
possible to evaluate system emse as a function of sys- 
tem operating time, and not just at the sampling in- 
stants. Use of the technique is indicated where system 
settling time is long compared to the operating time, 
1.€., when the system cannot be considered to be in the 
steady state. 

The technique utilizes readily available tables of 
“modified” zg transforms and the application of elemen- 
tary residue theory for the evaluation of the complex 
integrals involved. The artifice of truncation is em- 
ployed in order that certain time-domain integral ex- 
pressions concerned in the derivation of the model may 
be expressed in the frequency domain in closed form. 
Truncating a fixed, linear filter weighting function con- 
verts the filter to a special type of variable filter, whose 
weighting function is required to be zero for values of the 
age variable greater than the operating time of the sys- 
tem. The technique of truncation is readily carried over 
into the frequency domain, using complex convolution, 
for both analog? and sampled-data filters. 

While the frequency-domain statistical model pre- 
sented in this paper serves as a basis for wide areas of 
investigation and design in terms of digital integration 
and hold dynamics, it should be noted that for other 
cases, where the systems considered do not have in- 
finite memory, judgment must be used to ascertain 
whether the transient statistical model is necessary. If 
the system operating time is long compared to the sys- 
tem settling time, conventional steady-state mse evalua- 
tion techniques may be justified in terms of their rela- 
tive algebraic simplicity. 

The model of this paper is especially useful for evalua- 
tion of digital integration programs, followed by extra- 
polator-hold dynamics. Sampled-data systems of this 
kind are a vital part of many present-day inertial navi- 
gation systems, where optimum performance is tanta- 
mount to operational success. The use of the model of 
this paper allows evaluation of such systems in terms of 
the emse at a finite operating time. Heretofore, this has 
not been possible, since conventional steady-state mean- 
squared error techniques give rise to an unbounded 
result. 
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APPENDIX | 


DERIVATION OF THE FREQUENCY-DOMAIN 
STATISTICAL MODEL 


The assumptions stated in Section II pertaining to 
the error-generating model of Fig. 1 are assumed valid 
for the following development. 

The digital filter D*(z) is assumed to operate on purely 
numerical data. Hence its dynamics may readily be de- 
scribed in terms of a rational function of the dimension- 
less complex variable z. 

The sampled data system dynamics following the 
digital filter g(t) (a digital-to-analog converter, for 
example) are assumed to respond only to the amplitudes 
of the digital filter periodic output pulses. Hence, these 
analog dynamics may be considered to be excited by 
periodic impulses with areas equal to the corresponding 
periodic numerical output of the digital filter. Thus, no 
weighting constant need be used to account for finite 
pulse width, and all samplers may be considered to be 
equivalent to ideal “impulse modulators.” 

Considering the jth (typical) members of the signal, 
noise, and error ensembles, the output of the error- 
generating model may be written in terms of the perti- 
nent weighting functions of the error-generating model. 
Subject to the conditions imposed on the convolution 
processes by realizability and the switch closing at t=0, 
the error at a time ¢>0 is 


D 


e(t) = f ha(u)v(t — u)du — >> r(nT)f(t — nT). (40) 


n=0 


The second term in (40) is merely a summation of im- 
pulse responses of the sampled-data channel to a peri- 
odically sampled ensemble member, 7;(”7). The upper 
limit on the summation, p, is defined so that 
PT St<(ot+DP. 

Since the expected value of the squared error is of 
interest, (40) may be squared. Assuming a dominated 
convergence, the various terms may be rearranged, and 
the expectation of the squared error ensemble (at a time 
t>0) taken. Thus, the ensemble mean-squared error 
may be written 


(e7(t)) = f f ha(u)half)(vi(t — u)oi(t — £))dudg (41a) 


= Ar ha(u)du aC — nT)(vi(t — u)ri(nT)) (41b) 


Dp D 

+ Soft — nT) DOSE = kT) ri(nT)r(RT)). (41c) 

n=0 k=0 

The brackets ( - - - ) denote the operation of averag- 
ing over all ensemble members at a time ¢>0. Note that 
no assumptions concerning ergodicity have been made. 
Ensemble averages must be used because the squared 
error ensemble is, in general, a nonstationary process for 
all ¢>0. 

The expected value of the product of two variables, 
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x(u)y(y), is conventionally defined as the cross-correla- 
tion function of the variables. If x=y, 


E| x(u)y(¢)} oS (xi(u)yi(F)) = bey (Us, §) (42) 


is simply the autocorrelation function of x. When {x} 
and {y} are stationary random processes, the correla- 
tion function of (43) is a function of the time differences 
ouly. Since |v} is a stationary ensemble for ¢>0, (41a) 
may be written 
t t 
I, -{ ff hau) hal)dboo(u — ¢)dude. (43) 
The upper limits of the integrals in (43) may be ex- 
tended to infinity if the fixed filter weighting function is 
modified and considered as a special class of variable 
filter so that 


ha’ (t, u) ie ha(n), 
ha’ (t, #) = 0, 


foru <i? 
fora > t. (44) 


This may be expressed mathematically by use of the 
unit step function 


UG foru >t 
U(u — t) a 0, fOr <b (45) 
Thus 
ha’ (t, w) = ha(u)[1 — U(u — 2)]. (46) 


This important modification technique is known as 
truncation.! Now (43) may be written 


= if [we u)ha' (t, €)boo(u — €)dudg. (47) 


Eq. (47) may be written in the frequency domain using 
the uniqueness of the bilateral Laplace transform. 
g$.»(u—f) may be written in terms of the inverse trans- 
form of its power spectral density function. Thus 

jo 


1 
Pov (U a §) = om Puy (sherds, (48) 


T] J —joo 


(48) may be substituted into (47), and, assuming a 
dominated convergence, we may rearrange integral 
signs and regroup terms to obtain 


1 goo (-) 
EE eetsseng Bn(s) f ha’ (t, ues“du 
20] —je —o 


. if ha’ (t, (eS deéds. (49) 
It is seen at once that the two real integrals in (49) are 
simply bilateral Laplace transforms of the modified 
comparison channel filter weighting function. 

Eq. (49) may be written in the frequency domain.?® 


® Equivalent to the development given by Johnson, op. cit., foot- 
note 2. 
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®,,(s) Ha’ (s, t) Ha’ (—s, tds. 


—Joo 


1 
ZT, = (ca? (t)) = — (S50) 
20] 

H,/(s, t) may be calculated from (46) using complex 
convolution. Since ha(t) is, in general, the weighting 
function of a nonrealizable filter, it is assumed that 
fq(s) may be described by a bilateral Laplace trans- 
formation. H4(s) is therefore defined for the R,(s) lying 
in a strip in the s plane which, from a practical con- 
straint, includes the s=jw axis. Thus H,'(s, t) may be 
expressed. 


e (s-w)t 


1 
Ha'(s, t) = Ha(s) — oat Haw) = 
47). i 8) 


aes at 


dw (51) 


where I’, is a contour enclosing the poles to the left of 
the analytic strip for Ha(s). In the event that H4(s) is 
realizable, I,, encloses all the poles of Ha(w) excluding 
is: 

The next step in writing the ensemble mean-squared 
error as a function of system operating time is to con- 
sider (41b). The upper limit on the integral sign may 
be extended to infinity following (44)—(47). Since {ov} is 
a stationary ensemble for ¢>0, and {r(n Tay | is a station- 
ary random number sequence ensemble for t=nT>0 
(where is an integer), the correlation function involv- 
ing v;,(¢—w) and 7;(n7) is stationary for u<t and n>0. 
Thus (41b) may be written 


I,=—- 2f "hal (by u)du > fl — nT )dbo(nT — t+ u) 


—2 h=0 


BSH P20, 452) 


The correlation function in (52) may be written in 
terms of its inverse Laplace transform. This may be 
substituted into (52), similar to the operation on (47). 
Thus, 

72 
-— ®,,(s)Ha'(—s, the** 


2nj —joo 


Vic, = 


63 ft = nPye" ds. (53) 


n=0 
The summation in (53) may be written in closed form 
through an extension of the truncation technique shown 
in (44)-(46). Since in general, ¢ may lie at or between 
sampling instants, the substitution £=p7+mT is made, 
where 


ee ee 
{ O<m<i i 


A further substitution in the argument of f(t—nT), 
l=p—n is made. Thus 


l=p 


> f(mT + 1T)e~8'Tes??, 


1=0 


(54) 


Note that the e*?7 factor cancels when (54) is substituted 
back into (53); it will therefore be neglected in the rest 
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of this development. The upper limit of summation in 
(54) may be extended to ~ if the weighting function is 
modified by the truncation process. 


Ge ae Sy Gp eae forl < p 
Heme mp a Agel SE (55) 
Using the unit step function, 
f(T, mT +17) = f(mT +1T)[1 -— UCT — pT)], (56) 


which is equivalent to (55). Eq. (54) may be written, 
noting the development above, to define the truncated, 
modified, 2 transform of f(t). 


F*(z, m, p) = Dl f'(oT, mT + ID)e" fore = e. (57) 
1=0 

The actual significance of (57) may be brought more 

clearly into focus by noting Barker’s definition® for the 

“modified” zg transform of a continuous time function. 

(Sometimes called the z, m transform). Extensive tables 

of z, m transforms exist in the literature.*'!° 


Gp*(z, m) a >> g(mT +17)z-! (after Barker). (58) 
1=0 


Comparison of (58) with (57) shows that (57) is very 
similar to (58) except for a factor of 271. If tables of z, 
m transforms are used which are based on (58), a par- 
ticular transform must be multiplied by z to be used in 
(59) below. 

Since the variable filter in (57) results from the trunca- 
tion process, similar to that used for ha’(t), we may ex- 
press the right-hand member of (57) by taking the 
“improved” (a Barker transform, times z), modified, 2 
transform of (56). The result is seen to involve complex 
convolution in 2. 


F'*(z,m, p) = F*(z, m) 


(z/y) dy 
Fly) = 50 
(y Seay (59) 


T; is a contour enclosing the poles of F*(y, m), but ex- 
cluding y=z. Note that F*(z, m) may simply be 
expressed in terms of the improved z, m transforms of 
the sampled-data channel dynamics. Since the digital 
filter responds only at sampling instants, its improved 2, 
m transform is independent of m. Thus, 


F¥(z,m) = D*(z)G*(, m). 


20] ie fe 


(60) 


Noting the developments above, (53) may finally be 
written as 


i= = Oni i [®..(s) Ha’ (s, the? | F’* (eT, m, p)ds 
= — 2(ca,(t)cx(t)). (61) 


10 £, I. Jury, “Additions to the modified z-transform method,” 
1957 WESCON ConveENTION REcorD, pt. 4, pp. 136-156. 
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It is shown in Appendix II that (61) may be written 


1 
Lo) 


TJ I 


Z[®.,(s) Ha'(—s, De"? | 


We 
-F’*(z, m, p) pe (62) 
The final step in deriving the ensemble mean-squared 
error as a function of system operating time is to con- 
sider (41c). The expectation (7,(n7)ri(RT)) is a station- 
ary correlation function for n, k>0O, and a function of 
only the discrete time differences. Thus ¢,,(kR7—nT) 
exists only for discrete arguments (” and k are positive 
integers). It may therefore be written as an inverse 2 
transform: 


1 
or (RT — nT) = ai) Or (a) eam das (63) 
I 


0] 
Eq. (63) may be substituted into (41c) yielding, upon 
rearranging terms, 


i n=D 
Iz = (67(t)) = —f &,,*(z) >> f(t — nT)z 


217 n=0 


a 


Sid ene 


k=0 2 


(64) 


Following the development for F’(z, m, p) in (53)—(60), 
we may write finally 


(e7(t)) = 1, +1e+ 73 


ie 2rj —joo 


®,,(5) Ha’ (s, t)Ha'(—s, t)ds (65a) 


Z[er(s) Ha'(—s, Ne" |F"*(z, m, p) —  (65b) 
v4 


TT) iP 


1 d. 
a —f{ B,*(o) F(z, m, p)F*(1/2,m, p)—- (65) 
TI YT 2 


I is defined as the “semi-open” line segment, 2| = 1 
(the unit circle), —7t+A<arg z<a+A, taken in a 
counter-clockwise sense. A is an arbitrary real number. 


APPENDIX II 


DERIVATION OF INVERSION INTEGRAL FOR 
THE TWo-SIDED zg TRANSFORM 


The latter two inversion integrals of (41) are of the 
form 


joo 
By —f A(s) B* (es?) ds. (66) 
dap J —je0 
A(s) and B(es™) are rational functions of s and e'”7, 
respectively, where the dependence on t=p7T+mT is 
neglected in this analysis since these variables are as- 
sumed to be constant for the evaluation of the integrals 
of (41). For practical reasons it has been tacitly assumed 
that the analytic strip for A(s)B*(e:") includes the 
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imaginary axis. Eq. (66) may be written as 


{ = (n+1/2)7(27/T) 
Day if A(s) B*(e7) ds (67) 
27) n= (n—1/2)5(24/T) 
or for 
ea; 
OS 
if 
1 n= J(r/T) 2a 
— D2 { A (: + jn 7) BEC )d (68) 
27] n=—0Y —j(r/T) L 
or 
ep j(r/T) 1 n=0 2a 
ane B*(e7) E Ds A (: + jn =) ds. (69) 
20] J —j(n/T) D n=—e L 


However, the bracketed term is recognized as the Pois- 
son sum definition of a pulsed transform; thus (69) be- 
comes 


7. j(n/T) 
— Bt (Ee) Ase las (70) 
2nj J —j(n/T) 
The transformation z=e*" in (70) results in 
1 dz 
—fRe@sea— (71) 
27] T Zz 


where I is the semi-open line segment defined as | z| =1, 
—a7 <arg z<7m taken in a counter-clockwise sense. The 
semi-open definition for the arg zg is necessary to pre- 
serve an analytic one-to-one mapping between s and g. 
The semi-open line segment may be closed either to the 
outside or the inside of the unit circle as shown in Fig. 
9 dependent upon the convergence properties of the 
integrand. This may require splitting up the integrand 
as demonstrated in Section III by specific example. 

It is readily seen that, in the event that the integrand 
A*(z)B*(z) has a singular point along the negative real 
axis, either of these closures will result in an alteration 
of the value of the integral. In this event the original 
semi-open line segment may be chosen as | z| ie 
—a+A<arg e<a+A where A real is chosen such that 
the closure may be made along a radial line along which 
the integrand is analytic. 


(a) (b) 


Fig. 9—Two closures of the semi-open line segment, I. 
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A Mathematical Representation of 
Hydraulic Servomechanisms™ 


J. J. RODDEN+ 


Summary—This paper gives a basic representation of a high per- 
formance hydraulic servo actuator. The discussion gives a means of 
calculating the servo gain and rate limit characteristics as functions 
of the design parameters. Assumptions are discussed that would 
allow simplification of the equations for their application with com- 
puting equipment. Representation of the supply accumulator and 
pump is included. The effects of equipment nonlinearities can be 
incorporated into the basic model with appropriate modification of 
the computer program. 

The work of this paper has been applied to the design and analysis 
of missile flight control systems where the rate limit characteristic of 
the actuator is significant to dynamic performance. 


INTRODUCTION 


S the analysis of the Polaris flight control system 
proceeded, the mathematical models of the in- 
dividual components were increasingly refined. 

The analysis continually considered more individual 
anomalies and nonlinearities as the system design be- 
came more fixed. During the early part of the prelimi- 
nary analyses, the hydraulic servos were considered per- 
fect (z.e., controller position at all times equaled the 
autopilot position command). As the analysis continued, 
more complicated representations were used. The sim- 
plified dynamics of a first-order lag were simulated as 
the servo. Later, position limits were incorporated in the 
equations to simulate the mechanical stops in the servo 
actuator. Simple fixed limits on controller rate capabil- 
ity were then used to simulate the finite flow capability 
of the hydraulic pump-accumulator system. 

The functional relationships of the parts of the servo 
system are shown in Fig. 1. From measurements of 
missile motion, the autopilot produces a command signal 
which is fed to the servo amplifier which in turn controls 
the servo valve flow. The servo valve flow positions the 
control surface which in turn produces a stabilizing 
force on the missile. 

The following derivation is a further refinement of the 
servo description. It includes a variable rate limit as a 
function of the hydraulic fluid pressure, the nonlinear 
pressure-flow relations, the system friction, the pump, 
and the electronic circuit characteristics. This deriva- 
tion gives a basic representation of the behavior of a 
hydraulic servo valve. Included for generality is a 
typical representation of a supply accumulator and 
pump. The effects of equipment nonlinearities, such as 
valve dead band or hysteresis and oil compressibility, 
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Fig. 1—Functional diagram of the hydraulic system in the 
flight control system. 


are not discussed in this report; however, they can be 
incorporated into the basic equation with appropriate 
modification of the computer program. 


DERIVATION OF SERVO EQUATIONS 


A typical setup of a control valve regulating the pres- 
sure and flow to a driving piston is shown in Fig. 2. 

The control valve is supplied with a high pressure 
source (P4). The total flow (Qr) is distributed between 
the piston flow (Q) and leakage flow (Q7). A schematic 
representation of Fig. 2 is shown in Fig. 3. 

For a positive valve displacement (€), the flow is dis- 
tributed as follows: 


Valve Position Flow 
A open piston flow plus leakage 
B closed to minimum leakage flow 
c open piston flow plus leakage 
D closed to minimum leakage flow. 


The significant pressure drops occur at the valve 
openings (orifices) within the valves A, B, C, and D. 
These pressure drops can be determined from the orifice 
flow equations. 

The flow of a fluid through a valve opening (orifice) 
is presented in Fig. 4. Neglecting the dynamic 3p V? 
terms, the flow of an incompressible fluid through a 
valve opening (orifice) is given by 


Or = VK flv Pa — Po 


where 


./K =a constant 
€=valve opening (orifice) 
f(€) =opening function 
(P,— Ps) =pressure drop across orifice. 
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= = 


Pa=pressure source 
Pr=pressure return 
¢=valve displacement 
Qr=total flow 
Qr=leakage flow 
Q=piston flow 
P,=pressure on piston 
P:=pressure on piston 
6=piston displacement 


Fig. 2—Hydraulic control valve and actuator. 


Qr=flow through orifice 
P,=upstream pressure 
P,=downstream pressure 


Fig. 4—Flow through an orifice 


4 
7 Valve Opening (e) 


Fig. 5—Valve opening function. 


The relationship between the opening function [f(€) | 
and the valve opening (e€) is shown in Fig. 5. 

The opening function [/(e) | depends upon the valve 
opening (€) and the minimum effective valve opening 
(y); this latter value (vy) may be defined as the amount 
a perfect linear valve must be opened to yield the leak- 
age flow (Qz). The opening function [f(€) | is approxi- 
mated by 


eS resee 


Substituting this value in the orifice flow equation 
yields 


Or = VKV (Pa — Pr)(2+ 7’). 


Assuming a closed symmetrical control valve («=0), the 
pressure drop across each of the closed valve openings 
(A, B, C, and D) is equal to (Pa —Pr)/2. The leakage 
flow (Q;) is represented by 
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Or = yV KV (Pa =a Pp)/2, 


and the minimum effective valve opening (y) is repre- 
sented by 


OL 
JS KV (Pa — Pr)/2 


MS 


In the schematic diagram (Fig. 3), with the minimum 
valve openings effectively being y, the pressure drops 
through the various valve openings are as follows: 


Valve Position Pressure Drop Through Valve 
(Q + Qx)? 
A open P,— Pr= Kety 
2 
B closed P4g—P2.= (Qx)" 
Ky? 
(Q + Qr)? 
G IB Py= 
open A 1 Ke+y 
(Qz)? 
D closed Pi, — Pr= Ky 


The pressure drop from the supply pressure to the re- 
turn pressure (P4—Pr) equals the sum of the pressure 
drops across valve C (P4—FP;), across the piston 
(P,—P»2), and across valve A (P2— Pr). From this rela- 
tionship, the equation for the driving force on the piston 
(P,—P2) can be derived as follows: 


l| 


By Ps = 2a Pa) Gia at ee ee 


(Q+ ee | 
K(é+y)1 


(Pa — Pr) — 2) 


The differential pressures for a positive value displace- 
ment are shown in Fig. 6. 

Opening valves B and D and closing valves A and C 
results in a negative displacement in the control valve 
position and an interchange in the ram pressures P; and 
P». The differential pressures for both positive and nega- 
tive displacements of the control valve are shown in 
Fig. 7. The differential driving pressure can be written 
as follows: 


Py Pe=| (Pa = Pa) — ee sen (6) 


K(e 7°) 


where the function sgn (€) is (+1) or (—1) correspond- 
ing to the sign of (e). 

It is known that the valve leakage is small and that 
variations in its value have little influence on the per- 
formance of the valve. For the remainder of this analysis 
the valve leakage (Q1) will be assumed to be equal to 
the leakage for a closed valve as shown by 


QOL = KV (Pa — Pr)max/2. 


1960 


rential Pressure (P, - 


Diffe 


Negative Valve Displacement ( Positive Valve Displacement (¢) 


Fig. 7—Differential pressure vs valve position. 


The corresponding minimum valve opening (y) is repre- 
sented by 


= Qr . 
VKV (Pa Se Pe) aaet 2 


¥ 


Substituting this relationship in the differential pres- 
sure equation and neglecting the product of the valve 
leakage yields 


Pr Pa Ke 1207 
K (2 + 


Measurements of the control valve characteristic 
are made under the following conditions: 1) The piston 
cylinder is by-passed (P:=P:2), 2) the pressure drop 
across the servo valve (P4—Pp) is varied, and 3) flow 
measurements are made with the control valve wide 
open. The relationship between the differential pressure 
(P4—Pr) and the flow (Q) through the control valve is 
shown in Fig. 8. The piston flow rate (Q) for a variable 
valve opening is equal to ce,/AP; the piston flow rate 
(Q) for a wide open valve is equal to c./AP. 

The relationship between the valve characteristic (c) 
and the value of K (previously used in this paper) is 
shown by 


(Pi — P2) = sgn (e). 


2077 ) 
K(Pa — Pr) max 


c= V/K/2. 
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ure Drop (AP), psi 


Q=flow through valve 
c=valve characteristic 
AP=pressure drop across control valve 
e=fraction of valve opening =6,/démax and is equal to 1.0 for a 
wide open valve 


Fig. 8—Flow characteristic through valve. 


The relationship between the fraction of valve open- 
ing (€) and the piston displacement (6) is shown by 


e = 6./6 


€max* 


Substituting these relationships in the differential 
pressure equation yields 


2 


be 
Cee, eee Pr)b2 = (‘So 


c 
(P, — P2) = sgn (4 
1 2 (2 gn (5.) 
67+ : 
; CPZ fos PR)maas 


In the case where the motion of the piston is used to 
deflect the control surface, a direct relationship exists 
between the piston displacement and the deflection of 
the control surface (6); similarly, a direct relationship 
exists between the piston flow (Q) and the rate of de- 
flection of the control surface (6). This latter relation- 
ship is expressed by 


Op hele 


The moment on the control surface is found by multi- 
plying the inertia of the control surface (J) by the angu- 
lar acceleration (6) and equating this product to the 
difference between the torque due to the differential 
pressure (P;—P») and the friction load (T), as shown by 


Jé = Apna(P:i — P2) — (T) sen (8) 


where 


J =inertia of the control surface 

6=acceleration of the control surface 

a =lever arm around control surface pivot 
Ar=area of piston 

T =friction load (coulomb). 


The friction load is assumed to be of the sliding or 
coulomb type, and is constant in magnitude and op- 
posed to the motion of the piston. 

The acceleration of the control surface is obtained by 
substituting the differential pressure previously derived 
into the above equation and dividing by the inertia of 
the control surface, as shown by 
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5 9 ( Ans) 8° | 
A Ra 3 C (Pa = Pr) 


os ’ 
o= P,s—P sen (5.) — — sgn (6). 
7 (Pa R) (Hna22 gn ( 7 g 
bo diene | 
é CPx a Ppaax m= 


H1GH-PRESSURE SOURCE AND PuMP in Fig. 11. Whether the line pressure is to be determined 
as a function of the accumulator volume or the system 


to supply fluid to the servo control valve. This may exist flow depends on the value of the line pressure. When the 


as an accumulator tank with a pump supply as shown Pressure is greater than the accumulator precharge pres- 
in Fig. 9 sure, the system is operating off the accumulator. When ~ 


the accumulator is bottomed (drained) and the line 
pressure falls below the accumulator precharge, the 
flow comes directly from the pump. Whenever the pres- 
sure rises above the precharge level, operation resumes 
from the accumulator. 


Nominally some kind of high-pressure storage is used 


The accumulator is initially precharged with air under 
pressure P,,in and then partially filled with hydraulic oil 
which further compresses the air. The accumulator 
pressure is the pressure of the stored fluid and gas; it can 
be found from gas-law considerations, as shown by 


Op 
Pal Viair)™ =C, Ue nee (on for Op ~S Qn 
oa Or — On) 
where Pp — Piece) rOd 0. 
V total = at Voi Co 
HERS COE SR for air in an adiabatic The pump equations can take on other forms, but 
expansion 


these can be considered typical. 

Typical ranges of values for a high performance servo 
are given in Appendix I. A summary of the servo, pump, 
and accumulator equations, along with a schematic 


P,=pressure in accumulator 
Cr—constant tor the system = Pyia( Victa)*; 


thus 
Ge 


ry K Pump Accumuletor Flow Q (1n3/sec) 
( V total La. Wo i 1) Return Accumulator p 
Pressure _ R Pressure A 


psi) (psi) 


Pa 


For the high-pressure systems used with servo actua- 
tors, the relationship between P,4 and V,.j;; can be linear- 
ized as shown by 


Fig. 9—High-pressure system. 


Ee a ees 
LE = (——) Voit + ipa for PA > paee 
Ohi 


x 


The flow from the pump is in general dependent on the 
system pressure. Fig. 10 shows a typical characteristic. 


ee isa aa) eutor.Ca(Ps — Pa) Or; 
MM OFC Pm for Ge (Ps Py) > Op. 


Pump Without Accumulator 


For those flight control systems without an accumula- 
tor for storage of hydraulic fluid, the flow rate of fluid 
in the control cylinders is exactly equal to the pump 
output. The pressure of that fluid is found directly from 
the pump characteristic as shown in Fig. 10. In the 
previous case, the pump output in cubic inches of fluid 
per second was found as a function of the line pressure. 


In this case with no accumulator storage, the line pres- * 


sure is found asa function of the total flow rate as shown Fig. 11—Inverted pump characteristic. 
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computer diagram, is presented in Appendix II. When 
these equations are simulated on an analog computer, 
the resulting data can be plotted to yield a frequency 
response curve. The frequency response curve for a 


typical servo design with coulomb friction is shown in 
Bice) 12. 


SERVO GAIN AND RATE LIMIT 


The servo nominally performs as an integrating de- 
vice. This means that a unit signal into the servo will 
produce a rate in the output proportional to the input 
signal. The relationship between the position of the con- 
trol surface and the input signal is shown schematically 
in Fig. 13. 

This relationship is expressed by 


b= K,6.. 
In a hydraulic system, this relationship is met when the 
acceleration of the output is zero, 7.e., coast rate de- 
pendent on input alone. Neglecting viscous damping and 
return pressure, the acceleration for a positive 6, can be 


expressed by 
6 2 pes (Fs) 5. 
; c Ps T 


Si ns 


i) 62+ 7? J 


E Ara 
6= 


When the output acceleration is zero, the output rate 
is proportional to the signal input up to the rate limit. 
The output rate is expressed by 


where 


o= output rate 
6, =signal input. 


The servo gain can be expressed by 


J Ps 4/ T  deg/sec 
Kp a a a a 
(===) A ROP, deg 
C 
As the maximum rate corresponds to a wide-open valve 


(6.=6.,,,,), the relation between the servo gain and the 
rate limit can be expressed by 


where 


Ky =gain in deg/second/deg 
5, =rate limit 
-6e,ax = Maximum valve input. 


_ Fig. 14 shows a typical rate limit characteristic as a 
- function of system pressure for a high performance 
oe ; 


Ge ae 
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servo actuator. Laboratory tests on flight hardware have 
shown close correlation between predicted and measured 
servo performance. 


Appendix III summarizes equations of the modified 
servo dynamics. 


200 
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Fig. 12—Frequency response of a hydraulic system 
(one servo with 2° amplitude input). 
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6=output (control surface deflection) 
6=output rate 
6¢=input signal to servo 
K,y=servo gain 
s=complex variable 


Fig. 13—Simplified valve representation. 
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Fig. 14—Servo rate limit vs system pressure 
as a function of friction load. 
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CONCLUSION 


The simplified hydraulic servo equations are readily 
applicable in analog and digital trajectory programs. 
The simulation can then be used to investigate missile 
maneuvers in which control surface rate limit character- 
istics are significant to performance, such as missile 
launch and wind shear transients. A significant ad- 
vantage of using the servo model is to allow the analyst 
to determine directly the effect of hydraulic subsystem 
parameters on the flight control system operation. 


APPENDIX | 


GLOSSARY OF TERMS AND TYPICAL VALUES 


Symbol Description Typical Values 
6 control surface position +30 deg 
6 control surface rate +500 deg/second 
6 control surface acceleration +50,000 deg/second? 
be control surface error signal +5 deg 
5c control surface command +30 deg 
Pa accumulator pressure 2000-3000 psi 
Pg supply pressure 3000 psi 
P,», precharge pressure 500-1500 psi 
Pr reservoir pressure 0-100 psi 
Vr total volume in accumulator 10—20 in’ 
Vair air volume in accumulator 10-20 in? 
Voi oil volume in accumulator 0-5 in? 


0.01-0.05 in?/second 
4—8 in*/second 
0.02—0.08 in?/deg 
0-100 deg/second/deg 


Qt valve leakage 
Q» pump flow 
flow per unit stroke 
K, open-loop servo gain 
€ generalized valve opening 
Y minimum effective valve closure 


APPENDIX II 
EQUATIONS OF THE SERVO HYDRAULIC SYSTEM 


Neglecting the return pressure (Pr), the servo equa- 
tions are as follows: 


i Ara IP : 
da = + Go) sen (0, yee (6) 
( bd. ) 82 
62 ral max tics 
(6 Ps 
(Pi —— P») = Py 
(Oe soy?) 
Q = b[5| 
: artiny e for (5. ae ) a Dares 
6. = (6-6) for|s.—4| <4... 
—3. for (6. — 8) < — 5... 


Position Limits - 
for | 6 > i0max 
for | 6 | RaOnaes 


Pump Equations 


For variable displacement pump: 


Cee eon eae Or Cae 4) < Op, 
acs 
Op, + Che Pa —torCa( Ps — Ps) > Op, 


June 


For constant displacement pump: 


Cp fora <8 
ie ‘3 for Paes, 
For pump without accumulator: 
pees for Op < Qp, 
Es Shiv wi jmeiow 
Raye for Op > Op; 


Accumulator Equations 
Vou = Op — 0: 
c—¥ 


where 7 is the number of servos operating. 
Vege a VG = V total 
Ca 


Ps = 


es (V sie)” 


The last equation can be linearized to: 


1B. ie IPS 
Yi EN res ey Ty ae fot acs heen 
oil 


V. 


max 


These equations are shown schematically in Fig. 15, 


Fig. 16—Simplified servo dynamics. 
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MOopIFIED SERVO DyNAmIcs 


5 = Ky6. 
aa ae for | 8) > Snax 
Vb, for | 6 | <x Gnas 
| tS ena for (6. — 6) > Comes 
6. =} (6. = ) for | be ry 5 < on 
ia for (6. zy 6) Se aah 


max 
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Vee 


(- “as 
C 


The pump and accumulator equations are presented 
in Appendix II. 


A R@ 12), 


ae 


The simplified servo dynamics are shown schemat- 
ically in Fig. 16. 
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A General Method for Deriving the Describing 
Functions for a Certain Class 
of Nonlinearities 


RANGASAMI SRIDHART 


Summary—Since Goldfarb’s! original work on describing func- 
tions, a considerable number of papers have been published in which 
the describing functions of particular nonlinearities have been de- 
rived. It appears however that little effort has been made to classify 
the nonlinearities. Since the describing function method is one of the 
more powerful methods available at present to analyze nonlinear 
feedback systems, it appears desirable to collect the expressions for 
the describing functions of a few different types of nonlinearities in 
one paper. 

It is the purpose of this paper to derive the describing functions 
of two general types of nonlinearities and show how the describing 
functions of many other practical types of nonlinearities for which 
the describing function analysis is valid naturally follow. 


DERIVATION OF THE DESCRIBING FUNCTIONS 


HE two general types of nonlinearities to be con- 
sidered here will be designated as the piecewise 
linear type nonlinearity and the polynomial type 
nonlinearity. The input-output characteristic of the 
piecewise linear type nonlinearity consists of straight 
line segments, and the input-output characteristic of the 
polynomial type nonlinearity is described by a poly- 
nomial. It is assumed that the input-output character- 
istics of all the nonlinearities considered here are odd 


* Manuscript received by the PGAC, September 8, 1959; revised 
manuscript received, January 15, 1960. 

+ Dept. of Elec. Engrg., Purdue University, Lafayette, Ind. 

11. C. Goldfarb, “On some nonlinear phenomena in regulatory 
systems,” in “Frequency Response,” R. Oldenburger, Ed., The Mac- 
millan Co., New York, N. Y., pp. 239-259; 1956. This is an English 
translation of the original article which appeared in the Russian 
journal Avtomatika i Telemekhanika, vol. 8, pp. 349-383; September— 

October, 1947. 


functions with respect to the input. The describing 
functions of the two general types of nonlinerarities will 
be separately derived next. 


Describing Function of the General Piecewise Linear 
Type Nonlinearity 


The type of nonlinearity considered (Fig. 1), for the 
derivation of the describing function probably does not 
occur as the characteristic of a single nonlinearity in 
practice. However, it is quite conceivable that Fig. 1 
might represent the combined characteristic of multiple 
nonlinearities in cascade. The chief reason for choosing 
this nonlinearity is that many other piecewise linear 
type nonlinearities to which the describing function 
analysis is applicable are modifications of this general 
type, as will be shown below. In further discussions, the 
general type of nonlinearity shown in Fig. 1 will be re- 
ferred to as the type A nonlinearity. 

Let the input to the nonlinear element be x and the 
output by y. Then y can be represented as a function of 
x; 1.e., y=f(x) where f(x) is the input-output character- 
istic shown in Fig. 1. 

The describing function or equivalent admittance of 
a nonlinear element is defined as the complex ratio of 
the amplitude of the fundamental of the output to the 
amplitude of the input when the input is sinusoidal. 

Using the same notation as Goldfarb, the describing 
function J,1(A) is 


Ini(A) = ge(A) + jb-(A) (1) 
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where is seen that the integral in the right side of (4) can be 
x broken up into a sum of twelve integrals since the ex- 
CA) = —f , f(A sin 6) -sin 6-0 (2) pression for the output consists of twelve different equa- 
TAS 9 tions [(18) to (29) in Appendix I], each valid over only 
1 Oe a certain interval. 
b.(A) = —f{ f(A sin 0) -cos 6-d6. (3) Thus, expressing f(A sin #) appropriately using (18) 
TAS 9 to (29), (2) and (3) can be rewritten as shown in Ap- 


endix II to yield (5) and (6). 
Eq. (1) may also be written in the following simple iets SEA AED: 


form: Re |Jn1(A)} = g.(A) 
: ie, 1 . 
iON al f(A sin@)-exp (—j)-d0. (4) =| ome TPO 2A aT a 
wAdo 
ire : 
In this definition it is assumed that the input x to the "(0s — 05) + ms + 2 (sin 261 + sin 204) — (m1 — ms) 

nonlinearity is A sin 6, where 6=wt. Here w is the fre- 

quency of the sine wave and ¢ is time. (m1 — ms) 


-sin 20> = 


a 
: —-(sin 263; — sin 26;) — 2m,— cos @ 
Referring to the output waveform shown in Fig. 1, it \ a ; 


NONLINEAR 


CHARACTERISTIC Output 


Output YrfCd 


WAVEFORM 


S 
CS) 
@ 


ie tae eh 


gee T+O2 Sine WAVE 


Fig. 1—Response of the general piecewise linear nonlinearity (type A) to a sine wave. 
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b C 
+ 4(m, — m3) 7 Cos 02 + 2(m, — m2) — cos 63 


a 


e 
— Ba ae cos 04 — 2(m, — m2) — cos | (5) 
Im j{Ji(A)} = 3,(A) 
1 Pm, (m, — m2) 
= —/| — (cos 20; — cos 26,4) - ———_—_ 
ae (ke, 2 2 
a 
-(cos 203 — cos 26;) + 2m, er sin 0, 
C 
+ 2(m, — M2) aun 63 — 2m, — sin 04 
e 
= 2(my = m2) oi sin | : (6) 


Notice that 61, 62, 63, 84, and 6; have been defined so 
that they all lie in the first quadrant. 

Thus, the describing function for the type 4 non- 
linearity is given by (5) and (6). However, it is some- 
times convenient to express the describing function in 
the polar form. Eqs. (5) and (6) may be rewritten in the 
following form: 
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Ini(A) a | Jni(A) | “exp (j-r(A)} (7) 
where 
Jni(A) a V g6?(A) che b.(A) (8) 
and 
b.(A) 
r( A) ="aretan : (9) 
ge(A) 


From the general equations (5) and (6), the describing 
functions of a large variety of piecewise linear non- 
linearities can be derived by considering them as modi- 
fications of the type 4 nonlinearity. 

Modifications of the Type A Nonlinearity: While con- 
sidering the modifications of the type A nonlinearity, 
the nonlinearities have been divided into two categories, 
viz., nonlinearities without memory and nonlinearities 
with memory.? The various modifications are shown in 
Tables I and II which include the describing functions 
for nine nonlinearities without memory and fourteen 
nonlinearities with memory. 


* Nonlinearities without memory are defined as those whose in- 
put-output characteristics are single-valued, and nonlinearities with 
memory are defined as those whose input-output characteristics are 
multivalued. 


TABLE 
NONLINEARITIES WITH MEMORY 


Characteristic Describing Function 


Modification 


of 


ge(A) = +[1m™, = -m,(@,+ ©) + (m,-m,)- 
(@,- 5) + ™ (Sin 20,+ Sin 28,) - 
valtalicy ( Sin 2, - Sin 205) - Bo coee) + 


ZimyrMs) 5 Cos G5 — 29) Cos 84 = 


b(A) = [ Fi (Cos Re, ~ Cos 29,) + 
(™m.-™2) (cos 203 - Cos 205) + 
Ks 
2m™,2 sin@, +2(™-™m,) z Sin 6, - 
A 


2™, gen = Se Sin Bp ] 


9A) = Ms [Tr - (@,+8,) + (03-65) + 


a ( sin 28,- Sin 20, + Sin RO,+ 


Sin 205) - 2( 2 Cos, - € cos6, + 


be(A) = Te [ 4 (cos 26, + cos 20,- 


cos 28, = Cos Z0s) +2( 5 Sine,+ 


May cantelae = 2 Ss. 
a oes $- Sina a 65) | 


ation 


mS 2 
o's . f 
aS Characteristic s $y Describing Function 
te ie cS ee 
SS a =| 
28 Su) 8 
40 Aol ha 
= = ™ |(-6,+0,+ 9,-9,) + 
F E/é b g,6A) cia [( 6,+ 8, 5-84) 


L (sin 28, - Sin20,~ Sn 20, + Sin 20,) + 
2 


2 (-acos@,+ bCos8,+ c Cos @, - 
A 


dcos OQ, J 


b(A) = ul + (cos 20, ~ Cos 26, + 
Cos 20, - Cos 26,) + % (asine, - 


bSin@, + C Sin@,-d. sin, ) | 


b.(A) = - 28 (Sno, - Sn 93) 


= Lf 2 (Am)-™M5) 9, + (tm-m2): 


(03-95) + TMs, ca (m,-m; ) Sin 20, - 


(aa,-m,) (Sin 203 — Sin 205 ) + A(m,-Ms): 
i 


. 6 cos®, + 2 (m,-ma) cos ©; - 


(cm) (cos 20, — C0520, )+ 


2M.) S Sv Oy ~ 2CM- Ma) S Sn 8, | 
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TABLE 1 (Cont'd) 


= -— 
=I 
S Characteristic s Describing Function 
Characteristic 5g Describing Function z = 
= Acs 
Lex | 
ao a7 
I H |m=0]g(A) = — [2m,0, + (m,-m, )(0,-6,)- 
g fA) = = [m,(-, + 29,- ,)-+(m,-m,)- ™, Sin 20, - a 20,- 89265) + 
D A |™m3=0 : 
(0,-@,) + TM, (Sin 28, ~2Sin 20, + Am, 8 Cos 6, + 2(m,- mz) = cos®, — 
Sin 26,) ~ (Sh Ba) ( Sin 20, - 2(m,-m2) & cos9g | 
Sn 26,) - 2m, &-CosO, + aes rasa a 2 +i an 
2 be(A) = + (m,-m2)[ $ (cos20, - 
4m, b cas @+ (Mm -mz) Cas Q,— Ti 
A cos 265) + 2 &. 8InO,-2E SnGg ] 
am, d cosQ, ~ R(™:-™2) 2 cose, | A 
cy A ae ; 
A)= Syl Re FO Oe Sn Zone 
b,(A) = +[ Bi (cos 20, - Cos 20,) + J el ) TT 7 ae ae aa 
e 
b 4 (Sin 28, ~ 31m 285) + 2 (2b cose; + 
™2 (™M)-™M2) (Cos 20,- Cos 205) + Se A 
2 c Cos 8, — € Cos @s)] 
is Sin@, + NE ves Pes a8 me ey a) es a 
am, g sinG, ~ 2(m.-ms) & Sind | bea) = Te [4 (cos 20; - cos 205) + 
2 c Sin 8 - € Sin Gg) F 
g (A) = ™ iG ©,+ 20,+ 9,-98,-9,)+ ame < ] 
E OO ~ 7 
+( Sn 28, - 2 Sin ZOZ- Sin ZO, + Sin2g, + 
Sih 205) + 260 Cos O,+2bCos 82+ K gA) = ue [ (62+85) -% (81n20,+ 


c Cos ©, — dcos 84 - € Cos Os ) } 


tin 28, ) Fees CosO,+ ¢ Cos @,) | 


bo(A) = | £ (cos 26, + Cos 203- 
e T Lz be(A) = mY 5 (cos 20, -— cos 28,)+ 
i 


cos 26,- Cos 25) + = (a sin 6,+ 


2 (c Sin@, ~ b Sn ©.) | 


c Sin@, — dSin@, - © Sth 85 ) | 


Characteristic Describing Function 


ification 


ge(A) = = [ am, +(m,- m2) {(@,-85)- 


M H |m,=m 
4 (sin 20, - Sin 205) + % (c Cos 8,- 
eCos@s)} ] 
be(A) = Cte (coe 28s Cos — 
& (c Sin 6 - € Sin 8s) |] 

N ie ™m,=0 g.(8) = TM [T +(8,-5)- 4 (Sin ze, - 


Bin 205) + 2(c Cos 8; ~ € Cos Os } 


be(A) = Muy (cos 20, ~ Cos 20,)+ 


| a rae Sin a, -e@ Sin 8s) ] 
ae 


= 2™, tS 2) et 
w lezA | 9c"? aha 2 2S zee 
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TABLE II 
NONLINEARITIES WITHOUT MEMORY 


For all the nonlinearities without memory, 6.(4)=0 


es 
g2 Characteristic E a3 Describing Function 
Characteristic 3 2 Describing Function zs af r | 
= ace T 12 || exe) 
Ba ae ge(A) = (MM )(20,- si 262 + 
4 a Cos 8) + Ms; 
a |d=a g fA) = +| m,(-20,+ Size 
ahgpas I = cos @,) + (™M)-m; )(20,- Sin 20,+ 
45 cos@,) + Tm, ] y t | m,=0 
= ! - Sin Bee 
9, (8) = Mi) 2e, Sin 20, +4 Pc 39,| 
Pp |m,=0 es, 
g.(A) = Male, -9,) + (S20, - 
| sm 20, ) + ete ae Cos 6,)] v t |m,=0 - 
get) = ms [ma 26,2 S1n 20, + 
4 a cos 2, ) | 
Pp |b=a 
g, (A) = +[™, {(T-20,) + sin26,}- 
Ww 
+ (m;a -B) cos 2 | 
| 
| 
s | R |m;=0 
| x 
5S _ 4B 
; | | g.(4) = See 
5 a | 
Describing Function of the General Polynomial Type n 
Nonlinearity r oF 
2 ets + GA 
The input-output characteristic of a general poly- re me | 
nomial type nonlinearity is described by the following r( , ) 
equation. There is no loss of generality in assuming that 
n is odd in 3a 
+ ¢24—— + ¢, — (11) 
| | 4 2 
= a —2 n—2 
Ly gC a | BT ey 9 
b.(A) = 0. (12) 


+ cpigra™4+|ae| + +++ +eg-a-|x| tere. (10) 


The reason for making use of the absolute value signs 
in the right side of (10) is to make f(«) an odd function 
with respect to x. 

From the derivation in Appendix III, it is seen that 
the describing function of the polynomial type non- 
linearity described by (10) is given by (11) and (12). 
Thus, 


n+ 2 {n+1 
ih} 1 
ee ed ee ere 
(A) =—=| Am — —— Ft Ga A? ——_ 
Pa He n+3 n+2 
: if i Be 
2, 2 


Eq. (11) may be expressed in the following compact 


form 
aw 
= 
2 
(- a *) 
JP | SS 
2 
In (11) and (13), T represents the gamma function. 
A special case of the polynomial type of nonlinearity is 


the nonlinearity characterized by an integral power of 
the input. The input-output characteristic of this type 


W n 
g(A)=—— > GAP (13) 


JT k=1 


of nonlinearity is defined by 
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y = f(x) = c-x" for n odd (14) 
Gouge ao = 

y= f(a) = { forneven. (15) 
GB? 8G 49 <0) 


From the derivation in Appendix III, the describing 
function of either of the nonlinearities characterized by 


(14) and (15) is given by 
(" =e -) 
ip 
Z 


i) 
b, (A) = 0. (17) 


Special cases of (14) and (15) which occur frequently 
are the cubic nonlinearity defined by y=x? and the ab- 
square nonlinearity defined by y=x|x|, respectively. 
Substituting 2 =3 in the right side of (16), it is seen that 
for the cubic nonlinearity, g.=2?-c-A?. Similarly, sub- 
stituting »=2 in the right side of (16), it is seen that 
for the absquare nonlinearity, g.(A) = 


8cA 


— ie) 


37 


(16) 


CONCLUSIONS 


The describing functions of two general types of non- 
linearities have been derived. The two general types are 
called the piecewise linear type nonlinearity and the 
polynomial type nonlinearity. A large number of non- 
linearities which occur in practice are shown to be modi- 
fications of these general types of nonlinearities. The 
piecewise linear type nonlinearities are divided into,two 
groups, v7z., nonmemory type and memory type devices. 
The describing functions of all the piecewise linear type 
nonlinearities are tabulated. 

The plots of the describing functions have not been 
included here since it is not possible to draw general 
plots for most of the cases considered. The describing 
function plots for some of the simpler types of non- 
linearities are drawn in Goldfarb’s paper.! In the more 
complicated types of nonlinearities, there are too many 
parameters associated with the nonlinearity so that the 
describing function plots will consist of families of 
curves. It is felt that it will be simpler to evaluate the 
describing function for any nonlinearity with a particu- 
lar set of parameters by substituting the values of the 
parameters in the formulas derived rather than by 
drawing whole families of curves for each nonlinearity. 


APPENDIX | 


SoME RELATIONS ASSOCIATED WITH THE GENERAL 
PIECEWISE LINEAR TYPE NONLINEARITY 
SHOWN IN Fic. 1 

The input-output relationship of the general piece- 
wise linear type nonlinearity shown in Fig. 1 may be 
expressed as follows. 


= 0 it Oo: 
oa ee DS 


“> 0-18) 
Se ONL) 


7 = 0 


y = mi(x — a) 


IRE TRANSACTIONS ON AUTOMATIC CONTROL 


June 


B 
se msl a a (s oe: =| a> b (20) 
m3 
y = m(x — a) CS <0 ee 
(2 (ee\ | el ee ee 
a ALPE Cage ee as Saas OS OS OR 
ay 2 D_E Ss 
y = m(x — d) de 63 4 Oe 
0 —a<ux<d (24) 
y = m(x + a) —b<*4<—a;%<0 (25) 
B 
y=m[x+(o-—)| L <a (26) 
M3 
y = m(x + a) —b<x<-—e;4>0 (27) 
Der eLe 
y = mal ( )| —e<x<—¢; 4#>0 (28) 
D-—E 
y = mi(x + d) —c<x<—d;%>0. (29) 


Let the input to the nonlinear element be x where 


“= A sin 6. (30) 
Here 
6 = wt (31) 
where w is the frequency of the sine wave. 
Referring to Fig. 1, it is seen that 
6 ae (32) 
= arcsin — 
A 
56 
6. = arcsin — (33) 
6 ee (34 
= arcsin — 
3 a ) 
ae 
64 = arcsin — (35) 
€ 
6; = arcsin — (36) 


Here 61, 62, 63, 64, and 6; are associated with the 


corners of the input-output characteristic shown in 
Fuge SL; 


APPENDIX IT 


DEVELOPMENT OF DESCRIBING FUNCTION EQUATIONS 
FOR THE GENERAL PIECEWISE LINEAR 
Type NONLINEARITY 


In this section the right side of (4) will be evaluated. 
Substituting for f(A sin 6) from (18) to (29) in (4) yields 


4 a 
Ji Ay =| m,(A sin @ — a)-exp (—76) -d0 
TA 6 
O09 
+ m3(A sin @ — k;)-exp (—76)d0 


65 
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™—O5 
+ m,(A sin @ — a)-exp (—j6)d6 
T™—B9 
T—O3 
a m2(A sin 8 — ky) -exp (—j0)d0 
7—O5 
w—O4 
+ m,(A sin @ — d)-exp (—76)d0 
703 
1T+62 
+ m,(A sin @ + a)-exp (—76)d6 
T+0,) 


24—02 
+ f m3(A sin @ + k3)-exp (—76@)d6 
T+O 


2r—O65 
+ m,(A sin@ + a)-exp (—76)d6 
2r—O5 
2x—83 
+ m2(A sin @ + ko)-exp (—70)d6 
24—O5 
24—O4 
~ m,(A sin# + d)-exp (—j0)-<0 |. (37) 
2r—O3 


In (37), &2 and k; are defined as the following quantities: 


De — Ee G8 
SET RET 
B 
m3 


Evaluating the first integral in the right side of (37), 
62 


m,(A sin @ — a)-exp (—76)d6 


61 


62 A 
= m fi os [1 — exp (—270)] — aexp (0 dé 
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A 1 a : 
= Mm, \- [ + — exp (— 250) | -+ — exp (0 
23 2j J 


6; 


m, { A 1 SS IAG 
= m1 | — 0;) + — (exp. — 2762 — exp — 2) 
2 2] 


+ a(exp — 70. — exp = jn) . (40 


Similarly the other integrals in the right side of (37) 
may be evaluated and (37) solved to evaluate Jni(A). 
Separating the real and imaginary parts of Jni(A) yields 
(5) and (6). 
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DEVELOPMENT OF THE DESCRIBING FUNCTION 
EQUATIONS FOR THE GENERAL POLYNOMIAL 
TypE NONLINEARITY : 


_ In deriving the describing function of the general 
polynomial type nonlinearity defined by (10), each term 
of the polynomial will be considered separately. Thus, 


neath 
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for purposes of derivation two types of nonlinearities 
will be assumed. There is no loss of generality by this 
assumption since each term in the polynomial will be- 
long to one of the two types defined by (14) and (15); 
these two types will be considered separately. 


Case 1—n Odd 
Substituting from (14) in (2) and (3) yields 


1 2a 
ge(A) = if c(A sin 6)”: sin 6+ d6 
wA 0 
C 2a 
= Salt sin”t! @-d0 
TA 0 
4c mie 
= Af sin”t! @-d6 
us 0 
Ga) 
2¢ 2 
= So n—1 5 (41) 


Here, I’ denotes the gamma function 


1 Qa 
bA) = —{ c(A sin 6)” cos 6-d0 = 0. (42) 
TA 0 


Case 2—n Even 
Substituting from (15) in (2) and (3) yields 


1 T 
ge(A) = = f c(A sin 6)”-sin 6- dé 
TA 0 


2a 
-f c(A sin 6)»-sin 0a | 


C ™ Qr 
eh sin”+! 9-d0 -{ sin 0-40 
TA 0 T 


a /2 
= = Ant f sin”+!@-dA 
0 


(= =) 
T 
2¢ y, 


= A” 


ip 
2 
g-(A) = =| foe sin 0)”-cos 6-d0 
- faa sin 0)”-cos oat] 
= 0. (44) 
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Soviet Literature on Control Systems" 


P. L. SIMMONS} anp H. Aw PAPPOF 


Summary—Most of the better known articles from Soviet liter- 
ature on the subject of control systems published between January, 
1953 and March, 1959 are cited. Emphasis is on the theoretical as- 
pects of control systems. 

The items are arranged alphabetically according to author, with 
no attempt at classification. The first section includes all topics and 
the second section lists only articles which have English translations. 
Annotations are given only for articles which the bibliographer has 
examined. 

The introduction mentions some of the existing bibliographies in 
the field and discusses possible schemes for classifying bibliographic 
references to control systems. 


UST as a control device utilizes its sense apparatus 
to determine the nature of the control that it is to 
apply, so must control process analysts be aware 

of parallel investigations in the area if they are to main- 
tain some semblance of control over the inquiry. To aid 
in the search for and to provide easy contact with ma- 
terial in the field, several special bibliographies have 
been prepared in recent years. So far, these efforts (the 
present one included) have attempted only limited sur- 
veys of the literature. At some time in the future it 
will obviously be in order to combine the various results 
in a single reference list. Even in the special lists, the 
source material is confined primarily to work done in 
this country and does not consider developments in the 
U.S.S.R. Since the products of Russian science are of in- 
creasing interest to us, an effort is made in this report 
to supplement the existing bibliographies with reference 
to that work. 

In addition to the concentration on Russian litera- 
ture, the present reference list differs in other respects 
from the existing bibliographies. No effort has been 
made to classify the items according to type of control 
system. Use of a simple alphabetical listing is justified 
by the fact that there are alternative classification 
schemes and that the selection of one scheme over 
another is a function of purposes which are too special- 
ized for this bibliography. For instance, we might have 
classified the control systems according to the uses to 
which they are put. Clearly, though, the number of uses 
is extremely large. If we employed all of them in aggre- 
gating the reference items, the search time would be 
exorbitant, and we have no solid basis for choosing any 
subset of them. Again, a classification according to 
structure might have been used, but there too, there are 
many structural properties, and we have no sound 
reason to favor any one over another. 


* Manuscript received by the PGAC, February 1, 1960. Pub- 
lished by System Development Corp., Santa Monica, Calif., SP-125; 
October 29, 1959. 

+ System Development Corp., Santa Monica, Calif. 


A theory of control systems which has been stated in 
rudimentary form in another paper! does in fact miti- 
gate against a breakdown of control devices into per- 
manent classes of these types. In that report an attempt 
was made to show that all control systems can be 
brought under a single principle. According to that 
theory each control device, from the very simplest feed- 
back control unit through the varieties of extremal or 
optimal control systems or sampled-data systems to 
any one of the mnay kinds of adaptive control systems, 
can be seen as an element in a spectrum of control sys- 
tems. If the theory is sound, it justifies neglecting as 
categories many of the terms which are found frequently 
in the literature and which are most often used in classi- 
fication schemes. In fact, the continued use of these 
items for classification tends to gloss over strong simi- 
larities among control devices and creates pseudo or ir- 
relevant differences. 

Since an increasing number of articles are appearing 
in the field of control systems it becomes apparent that 
some mode of breaking down any list of references into 
manageable groups is imperative. This mode must not 
be such as to ignore important similarities or differences, 
however. Rather it must highlight the unifying principles 
where they occur, and it must put into sharp relief those 
features of control devices which are different enough 
to warrant the contrast. Any gains made in this direc- 
tion will tend to accelerate the flow of information and 
to increase our knowledge of control processes. 

In this country the area of adaptive control systems 
has been well covered by Aseltine, Mancini, and Sarture; 
they survey the field, give definitions, and provide a use- 
ful guide in a table of “Characteristics of Adaptive Sys- 
tems.”? Recently, Stromer has covered the literature in 
an annotated bibliography. Another area which 
Stromer has documented is sampled-data systems; his 
selective bibliography? is a good reference for the 
period 1955-1959. 

To our knowledge there does not exist a bibliography 
of Russian documentation in the field of control systems. 


1H. Pappo, “Theory of System Organization—1: Introduction to 
Control Systems,” System Development Corp., Santa Monica, Calif., 
SP-120; October, 1959. The second document in this series is “Theory 
of System Organization—2: Preliminary Formulation,” SP-121; 
October, 1959. 

2 J. A. Aseltine, A. R. Mancini, and C. W. Sarture. “A survey of 
adaptive control systems,” IRE Trans. on AuTomMatic CONTROL, 
no. PGAC-6, pp. 102-108; December, 1958. See p. 106. 

_ §P. R. Stromer, “Adaptive or self-optimizing control systems—a 
bibliography,” IRE Trans. on Automatic ContTROL, vol. AC-4, pp. 
65-68; May, 1959. 

*P. R. Stromer, “A selective bibliography on sampled-data sys- 
tems,” IRE Trans. on AuToMATIC CONTROL, no. PGAC-6, pp. 112- 
114; December, 1958. 
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Before a comprehensive bibliography can be prepared, 
this gap must be filled. 

If we can assume that Russian documentation in con- 
trol systems keeps pace with her automation of pro- 
duction techniques, the number of documents should be 
large. Newton cites statistics to the effect that annually 
the Soviet Union invests 27 per cent of its gross national 
product in new plants compared with 19 per cent in the 
United States. In order to maintain its high rate of ex- 
pansion, automation is keenly emphasized.® The fields 
in which we are interested—sampled-data systems, op- 
timal or extremal systems (minimal or maximal), and 
adaptive systems—have been actively developed by the 
Academy of Science of the U.S.S.R. and the Institute 
of Automation and Telemechanics, the two principal 
Soviet organizations researching the area. Since 1953 
the Institute has explored the area of sampled-data sys- 
tems and optimal control systems with great vigor. The 
Institute’s journal, Automation and Remote Control 
(Automatika 1 telemekhanika), enjoys high repute 
throughout the engineering world; proof of this lies in 
the fact that the National Science Foundation of the 
U.S.A. has made a grant to the Instrument Society of 
America for translating this publication into English. 
An outstanding individual in the institute is Prof. J. 
Tsypkin, who is mainly interested in sampled and 
quantitized data systems. Another prominent investi- 
gator is Pugachev, who has worked on the analysis of 
systems subjected to random disturbances. 

In an effort to keep track of this literature, the follow- 
ing reference list has been compiled. The bibliography 
cites most of the better known articles for the period 
January, 1953 to March, 1959. Emphasis is on the 
theoretical aspects of control systems. 

The first section of the bibliography, arranged by 
primary author, includes all topics. The second section 
lists only articles which have English translations. An- 
notations are given only for articles which the bibli- 
ographer has examined. 

As a final comment, it should be pointed out that a 
fairly large class of articles has been excluded from this 
list. These articles, for the most part, deal with very 
special problems in the application of control systems, 
and emphasize the electronics of control systems rather 
than theory. For this reason it was felt that they did not 
properly belong in the list. Persons who are interested 
in these details may consult the Library of Congress 
Current List of Russian Accessions, issued monthly. 
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tions in the field of literature and art issued by the Institute of 
Prague), vol. 8, pp. 972-973; November, 1959. In Czech. Trans- 
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Akinin, P. I. “Studying the periodic behavior of optimizing control 


5G. E. Newton, Jr., “Automation in the Soviet Union,” Elec. 


)  Engrg., vol. 78, pp. 844-847; August, 1959. yt = 
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mekhantka), vol. 19, pp. 339-348; April, 1958. 

A method is given of calculating the optimum frequency devia- 
tion in a single-channel telemetering system with fluctuating noise. 
The method is an analysis of the energy spectrum of the noise. 

Da-Chuan, S. “On the possibiltiy of a certain type of oscillation in 
sampled-data control systems,” Automation Express (Avtomatika + 
telemekhanika), vol. 1, pp. 11-14; May, 1959. 

This is an abstract only, not a complete translation. 

Druzhinin, V. G. “On the number of reserve sections,” Automation 
and Remote Control (Avtomatika i telemekhanika), vol. 19, pp. 1035— 
1038; November, 1958. 

Selection of the optimum number of reserve sections in any 
given automatic control system is examined. 

Ermakov, S. S. and E. M. Esipovich. “A way of forming transfer 
functions of sampled-data control systems with extrapolating de- 
vices,” Automation and Remote Control (Avtomatika 1 telemekhanika), 
vol. 19, pp. 395-401; May, 1958. 5; 

This paper deals with a way of forming conditional transfer 
functions of extrapolating devices for analog-to-digital conversion. 
The transfer function expression depends on the shape of the input 
pulses. 

Fan, C. W. “Concerning a method for analyzing sampled-data sys- 
tems,” Automation and Remote Control (Avtomatika i telemekhantka), 
vol. 19, pp. 288-299; April, 1958. 

Strelkov’s method, well known in Russia, for analyzing con- 
tinuous linear systems, is generalized on the basis of a discrete La- 
place transform and applied to the qualitative evaluation of the 
ripple in sampled-data systems. 

Fel’baum, A. A. “Automatic optimalizer,” Automation and Remote 
Control (Avtomatika i telemekhanika), vol. 19, pp. 718-728; August, 
1958. 
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Deals with the problem of constructing a machine which mini- 
mizes a function of several variables in the presence of additional 
restrictions. The circuits of different models are represented. 

Fitsner, L. N. “Choice of a power unit for an optimum automatic 
control system,” Automation and Remote Control (Avtomatika 1 
telemekhantka), vol. 19, pp. 1077-1086; December, 1958. 

Fitsner, L. N. “On selecting the power section for optimal automatic 
control systems,” Automation Express (Avtomatika 1 telemek- 
hanika), vol. 1, p. 8; April, 1959. 

This is an abstract only. 

Gamkrelidze, R. V. “On the general theory of optimal processes,” 
Automation Express (Akademiia nauk SSSR Doklady), vol. 1, pp. 
37-39; April, 1959. 

This is an abstract only. 

Gamkrelidze, R. V. “The theory of optimum speed of responses in 
linear systems,” Automation Express (Akademiia nauk SSSR 
Izvestia. Seria matem.), vol. 1, pp. 38-40; January, 1959. 

This is an abstract only. 

Gorskii, V. V. “A relay automatic position control system using a 
compound-wound motor,” Automation and Remote Control (Avto- 
matika 1 telemekhantka), vol. 18, pp. 832-842; September, 1957. 

A relay automatic position control system using a compound- 
wound system using an actuator is considered. The formulations 
for determining the output shaft speed and rotation angle during 
follow-up are deduced. The resulting relay system is considered to 
be close to optimal. 

Kilinski, A. “Measure of the reliability of electronic equipment,” 
MDF. K-185, Washington, D. C. (Translation of Przeglad tele- 
kamumikacyjny, vol. 31, no. 25, pp. 200-207; 1958). 21 pp. 1959. 

The most common definition of the reliability of “best” result is 
discussed in terms of probability, failure, time between failure, etc. 
Based for the most part on American periodical sources. (This 
translation can be ordered from the translator: Morris D. Fried- 
man, Inc., P. O. Box 35, Newton 65, Mass.). 

Krasovskii, N. “On the theory of optimal regulation,” Automation 
and Remote Control (Avtomatika 1 telemekhanika), vol. 18, pp. 1005— 
1016; November, 1957. 

Effective methods developed in an earlier paper are generalized 
for those cases. Formulation described above takes a different ap- 
proach to this problem. Gives results of works by Fel’baum, Pontri- 
agin, and Boltianski. Presents conditions for existence of optimum 
trajectories. 

Krug, E. K. and O. M. Minina. “Optimal transients in an automatic 
control systems having a bounded regulator unit,” Automation 
and Remote Control (Avtomatika i telemekhanika), vol. 19, pp. 8-21; 
January, 1958. 

The forms of the optimum transients in automatic control 
systems are determined for those with objects of various response 
characteristics, assuming the control valve to be position bounded. 
It is shown that there are difficulties in using continuous-action 
regulators to produce optimal transients, because of nonlinear 
converters. 

Kurakin, K. I. “Analytical method of synthesis of linear control 
systems in the presence of interference and with a specified dynamic 
accuracy,” Automation and Remote Control (Avtomatika 7 tele- 
mekhanika), vol. 19, pp. 402-412; May, 1958. 

An analytical method of approximation of transcendental 
transfer functions of automatic control systems is proposed. The 
functions were obtained with the help of fraction-rational func- 
tions to be determined by optimum control characteristics. The 
practical applications are outlined by example. 

Kurakin, K. I. “The design of linear follower systems from the cri- 
terion of minimum practical limiting reproduction error,” Automa- 
tion and Remote Control (Avtomatika 1 telemekhantka), vol. 18, 
pp. 447-465; May, 1957. 

The optimum transfer function of a servo system is determined 
for the case where the input to be reproduced is a known slowly- 
varying function of time and the noise spectrum is uniform over 
the working frequency range. The following design is based on the 
criterion of minimum practical follow-up error given previously by 
this author. Methods of producing an optimum servo-transfer are 
described which employ a corrector unit operating on dc. 

Letov, A. M. “Conditionally stable controlled systems concerning a 
certain type of optimum controlled system,” Automation and Re- 
mote Control (Avtomatika 1 telemekhanika), vol. 18, pp. 649-664; 
July, 1957. 

Attempts to show mathematically that a strictly linear system 
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designed to accord with any preconceived criterion of optimum 
quality can be altered to provide damping within the first swing by 
converting this system to one which is conditionally stable. 

Morosanov, I. S. “Conference on the theory and application of dis- 
crete automatic control systems,” Automation Express (Akademia 
nauk SSSR. Izvestia. Otdelinia tehn. Energetika i avtomatika), vol. 
1, pp. 10-11; May, 1959. 

This is an abstract only. The conference covered sampled-data 
systems and relay systems; there were also 13 papers devoted to 
the theory of self-adaptive systems, the principles of extremal sys- 
tems, and the description of equipment which has been tested. 

Morosanoy, I. S. “Methods of extremum control,” Automation and 
Remote Control (Avtomatika i telemekhanika), vol. 18, pp. 1077- 
1092; November, 1957. 

The main methods of extremum control are considered. Sys- 
tems are classified according to the method of seeking the optimum. 
Calculation of self-oscillation modes is demonstrated using a relay 
system as an example. Suggestions as to the practical applications 
are given. 

Morosanoy, I. S. and P. I. Chinayev. “Conference on the Theory and 
Application of Discrete Automatic Systems,” Joint Publications 
Research Service, Washington 25, D. C., Series L-731-37 (Transla- 
tion of Avtomatika i telemekhanika, vol. 20, pp. 100-106; 1959); 
April 14, 1959. 

Oldenburger, R. “Stabilizing control systems with a special signal,” 
Automation and Remote Control (Avtomatika 1 telemekhanika), vol. 
18, pp. 429-433; May, 1957. 

Linear automatic systems with two or more main delay links 
may be stabilized by injecting noise or a signal of sufficiently high 
frequency subject to the condition that system hunt is not too 
severe. The signal amplitude must be sufficient to drive a bounded 
element to its limits, e.g., must correspond to the control range of 
an auxiliary control valve in the regulator. Optimal nonlinear con- 
trol systems with one or more delay links can also be stabilized by 
injecting a suitable signal. 

Ostrovskii, IU. I. “Extremum regulation,” Automation and Remote 
Control (Avtomatika 7 telemekhanika), vol. 18, pp. 900-907; Septem- 
ber, 1957. 

The extremum controller is described in the Soviet and foreign 
(English) literature and the main designs are presented. A classi- 
fication by type is given. 

Ostrovskii, [U. I. “Pneumatic extremum regulator,” Automation and 
Remote Control (Avtomatika 1 telemekhanika), vol. 18, pp. 1093- 
1098; November, 1957. 

A pneumatic extremum regulator developed at the Institute of 
Automation and Remote Control, Academy of Sciences of the 
USSR, is described. Laboratory results are given also. 

Perov, V. P. “Synthesis of pulse networks and systems with pulse 
feedback,” Automation and Remote Control (Avtomatika 7 telemek- 
hanika), vol. 18, pp. 1129-1145; December, 1957. 

The optimum characteristics of pulse systems and their realiza- 
tions are determined, The optimum criterion adopted is the condi- _ 
tion that the error have a minimum dispersion for a specified dy- 
namic accuracy and for a specified system transient time. It is 
assumed that the driving function consists of noise and a signal 
and that the noise is a stationary random function, while the sig- 
nal is the sum of a random component. 

Pugachev, V. S. “The determination of an optimal system by some 
arbitrary criterion,” Automation and Remote Control (Avtomatika 1 
telemekhanika), vol. 19, pp. 513-532; June, 1958. 

The method is expounded for the determination of an optimal 
system by some arbitrary criterion of the Bayes type, out of the 
class of all functions to which this can be meaningfully applied. 
The solution of the principle of determining the operator of the 
optimal system is then-reduced to the finding of certain linear oper- 
ators of the minimum of some function or functionals. 

Pugachey, V. S. “Integral canonical representations of random func- 
tions and their application in deriving optimal linear systems,” 
Automation and Remote Control (Avtomatika i telemekhanika), vol. 
18, pp. 1017-1031; November, 1957. 

Theory of integral canonical representations of the random 
functions and their use in determining the optimal linear operator 
is given. Use of this method leads to a formula for the weighting 
function of an optimal one-dimensional linear system for the case 
where the observation interval is unlimited when the observed 
random function is a result of passing white noise through some 
system. 
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Rozeman, E. A. “On the limiting speed of action of servo-system 
with power, moment and rate limitations on the executive ele- 
ments,” Automation and Remote Control (Avtomatika i telemekhan- 
tka), vol. 19, pp. 622-644; July, 1958. 

The problem of the shortest transient response is considered 
for servo-systems with power, moment and rate limitations on the 
executive elements. The phase plane of the system states is sub- 
divided with respect to the character of the optimal transient re- 
sponse for the stated limitations. From the solution of the varia- 
tion problem, the form of the shortest response is then determined. 

Rozeman, E. A. “Optimum transients in saturating systems,” A uto- 
mation and Remote Control (Avtomatika i telemekhanika), vol. 18, 
pp. 539-555; June, 1957. 

Solves the problem of determining the nature of the shortest 
transient response in power-saturating systems. It is demonstrated 
that the optimum low for the variation of the actuating-motor cur- 
rent is almost linear for large heating time constants. A family 
of isochrone regions is plotted, and a comparison is made between 
optimum and current saturation. 

Shigin, E. K. “Synthesis of automatic control systems with a sign- 
changing input for the integrating corrective element,” Awutoma- 
tion Express (Nauchnye Doklady vysshei shkoly, Mashinostroenie 1 
priborostroente), vol. 1, pp. 3-6; April, 1959. 

Complete English translation. Discusses the last decade of 
work on automatic control systems theory which has covered op- 
timal transients responses and self-adaptive systems. 

Smyrova, N. A. “Additions to the table of optimal characteristics 
given by Solodovnikov and Matveev,” Automation and Remote 
Control (Avtomatika 1 telemekhanika), vol. 19, pp. 370-372; April, 
1958. 

An extension of tables of optimum characteristics is given here 
for corrective servo systems. 

Stakhovskii, R. I. “Twin-channel automatic optimalizer,” Automa- 
tion and Remote Control (Avtomatika 1 telemekhanika), vol. 19, pp. 
729-740; August, 1958. 

The circuit and some units of a twin-channel electronic auto- 
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matic optimalizer for the location of minima is described in detail. 
Experimental results are correspondingly given for its modes. 

Tsypkin, IU. Z. “Sampled-data systems with extrapolating devices,” 
Automation and Remote Control (Avtomatika 7 telemekhanika), vol. 
19, pp. 383-394; May, 1958. 

Automatic sampled-data systems containing extrapolating 
devices are investigated. Equations for such systems, describing 
the process at any given moment of time, are given, and the method 
of analyzing such systems is illustrated by examples. 


Velershtein, R. A. and A. A. Fel’baum. “Development of an almost 
optimal system by means of an electronic analog,” Automation and 
Remote Control (Avtomatika 1 telemekhanika), vol. 19, pp. 808-818; 
September, 1958. 


Velershtein, R. A. and A. A. Fel’baum. “Using an electronic simu- 
lator to formulate the circuit of an almost optimum system,” Auto- 
mation Express (Avtomatika i telemekhanika), vol. 1, pp. 40-41; 
January, 1959. 


Volchkoyv, K. S. “Some optimal relationships in an ideal ac controlled 
magnetic amplifier,” Automation and Remote Control (Avtomatika 1 
telemekhanika), vol. 19, pp. 76-85; January, 1958. 

The functioning of an ideal ac controlled, active load, choked 
magnetic amplifier is investigated. Optimal relationships are de- 
duced for amplifiers designed either for amplifying signals of one 
fixed frequency or for comparative purposes. 


Zalmanzon, L. A. “Some aspects of pneumatic controller design,” 
Automation and Remote Control (Avtomatika 1 telemekhanika), vol. 
18, pp. 93-98; January, 1957. 

Conditions are indicated under which it is desirable to supple- 
ment controllers of the normal type of automatic adjustment to 
the maximum or minimum of some quantity dependent on the 
controlled parameter. One possible way of doing this, by means of 
pneumatic devices, is considered; automatic adjustment is per- 
formed by a device which consists of a divider coupled to a system 
of parallels and intersecting pipes, together with certain other 
units. 
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Correspondence 


Adaptive and Optimalizing Control 
Systems* 


In recent literature new control concepts 
have been introduced under many different 
names: adaptive, optimalizing, identifying, 
self-optimizing, etc. Scanning these pa- 
pers! reveals that there is much confusion 
with respect to definitions and ideas, while 
a basic philosophy on these concepts is still 
almost completely lacking. 

The confusion may be partly due to the 
fact that the term “adaptive” has been 
taken from biology? where it already has a 
double meaning :race—maintaining behavior 
by natural selection; individual organism— 
maintaining behavior by learned reactions. 

Quoting some attempts to give defini- 
tions may be illustrative at this point. A 
general definition is:4 


Adaptation 


A process of fitting, or modifying a thing to other 
uses and so altering its form or original purpose... . 
In biology, adaptation plays a prominent part as the 
process by which an organism or species becomes 
modified to suit the conditions of life. Every change 
in a living organism involves adaptation; for in all 
cases life consists in a continuous adjustment of in- 
ternal to external relations. Some adaptations are 
produced afresh in each generation, others are trans- 
mitted by heredity, having been probably fixed by 
natural selection. 


Four definitions 


are: 8 


engineering-system 


—Adaptive control is a method of control aimed at 
obtaining optimum system performance even when 
there exists incomplete or inexact analytical or 
analog model of the process that is being controlled. 

—The term “adaptive” will be applied to any control 
system which measures, continuously or intermit- 
tently, the impulse response or some other function 
which characterizes the system and which makes 
use of this system-characteristic function to deter- 
mine and to generate the necessary forcing function 
to cause the system to behave in a desired manner. 

—A feedback control system is adaptive if the sensi- 
tivity with respect to a variable x is zero over an 
interval in x of nonzero magnitude. 

—An adaptive system is any physical system which 
has been designed with an adaptive viewpoint. 


Due to the many different schemes that 
have been proposed already under names 
such as adaptive, optimalizing, etc., it will 
be difficult to reach agreement with respect 


* Received by the PGAC, February 16, 1960. 

1 Surveys of papers on these control concepts: 

a) J. A. Aseltine, A. R. Mancini, and C. W. Sar- 
ture,” A survey of adaptive control systems,” 
IRE Trans. ON AUTOMATIC CONTROL, no. 
PGAC-6, pp. 102-108; December, 1958. 

b) M. J. Levin, “Methods for the Realization of 
Self-Optimizing Systems,” ISA, Paper No. FCS 
2-58; April, 1958. 

c) P. R. Stromer, “Adaptive or self-optimizing 
control systems; a bibliography,” IRE Trans, 
on AUTOMATIC CONTROL, vol. AC-4, pp. 65-68; 
May, 1959. 

2R. F. Drenick and R. A. Shahbender, “Adaptive 


servomechanisms,” Trans. AIEE, vol. 76, pt. II, pp. 
286-292; November, 1957. 
3W.R. Ashby, “Design for a Brain,” John Wiley 


& Sons, Inc., New York, N. Y.; 1952. 
4 Encyclopaedia Britannica; 1957. 

Taylor, “Problems of nonlinearity in 
rere or self-optimizing systems,” IRE TRANS. ON 
AUTOMATIC CONTROL, no. PGAC-5, p. 66; July, 1958. 

6L, Braun, “On adaptive control systems,” 1959 
IRE NATIONAL CONVENTION RECORD, pt. 4, pp. 32— 


44, 

7, Mishkin and R. A, Haddad, “Identification 
and command problems in adaptive systems,” 1959 
WESCON ConveENTION RECORD, pt. 4, pp. 125-135. 
(Definition due to Truxal.) 

8 J. G. Truxal, “Trends in adaptive control,” 
Proc. Natl. Electronics Conf., vol. 15, pp. 1- 16; 
October, 1959. 
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to a definition on a topological basis. This, 
however, is not too important at present. 
The thing that is needed mostly today is 
the recognition of the basic differences be- 
tween the “ordinary-control” and _ these 
newer control concepts. On this, perhaps, a 
general theory can be based. 


“Opp-FUNCTION” and “EVEN- 
FUNCTION” ERROR 


Let us have a look in the biological field, 
from which the term “adaptive” has been 
borrowed. The human eye is a very fine 
example because it shows both ordinary and 
adaptive types of control [Fig. 1(a)]. 

The iris controls the illumination level 
of the retina in an ordinary control system 
way; if the level is too high, then the error 
signal causes the iris to contract and vice 
versa. The sign of the error signal is a direct 
indication of the direction of iris change. The 
error signal goes to zero. 

The lens controls the definition of the 
image on the retina. Now there is no error 
signal that changes sign when the lens ac- 
commodates from too far a distance to too 
close or vice versa. The function of definition 
vs amount of accommodation, and so the 
error signal, has an extremum [Fig. 1(b)]. 
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(b) 
Fig. 1—(a) The human eye; two types of control. 
(b) Lens adaptation; “even-function” error. 
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FOR FEEDBACK ACTION 


DATA REDUCTION = LEARNING) 


Fig; 2—Comparison of “odd-function” and “even-function” error control. 


Now the proposition can be stated that 
all adaptive and optimalizing feedback con- 
trol systems have essentially the character- 
istics of this eye-lens control. Fig. 2 gives a 
comparison with ordinary feedback control. 

For the ordinary feedback the loop gain 
for the error signal is considered, in view of 
nonlinear computer-servo applications. Un- 
til a better word is found, the two types of 
feedback systems will be called, with respect 
to the fundamental difference, “odd-func- 
tion” (error) systems, and “even-function” 
(error) systems. 


From Fig. 3(b), it is self-evident that in 
the case of adaptive and optimalizing feed- 
back control, when the sign of the second 
derivative is known (maximum or mini- 
mum of the function), at least two observa- 
tions are required to locate the direction of 
the extremum with respect to these observa- 
tions. 

In order to perform control action we 
have to reduce the information of the two 
or more observations to one quantity. This 
process of data reduction could be called a 
“learning” process. It changes the “even-func- 
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(a) 


one observation 
(b) 


Fig. 3—(a) “Odd-function” error curve; one observa” 
tion is sufficient to know the direction of the de- 
sired control action. (b) “Even-function” error 
curves; one observation is insufficient to give the 
direction of the desired control action. 


tion” error into an “odd-function” error. After 
this process is applied, ordinary control prin- 
ciples can be used. 


DEFINITION 


Based on these considerations we can 
propose another attempt at a definition: 


An adaptive or optimalizing system 
is a system which mathematically has to 
be described by differential equations 
with time-variable coefficients (vari- 
linear or vari-nonlinear equations). The 
time functions of the coefficients which 
we have under control are determined via 
some “process of learning” from the en- 
vironment and/or the system character- 
istics in order to obtain an optimum be- 
havior of the combination system-+en- 
vironment. 


Part of the burden has been shifted to the 
“process of learning,” so this has to be given 
some thought. 


Tue Process or “LEARNING” 


Two or more observations on the same 
variable can be made: at the same time in 
different systems; at different times in the 
same system. In general, the first possibility 
is less attractive, for it requires two or more 
identical processes. For guaranteeing the 
identity of several processes we need a 
knowledge of, e.g., the physical/chemical 
theory and data which will surpass the avail- 
able knowledge and the economically feasible 
instrumentation. In cases where an approx- 
imate model may be used for comparison 
this method may be quite feasible. In many 
cases, we have to resort to the second 
method to derive knowledge from the sys- 
tem. 

The general scheme of “even-function” 
(error) control is given by: 


measurement of 
instantaneous values 


“even-function” error 
“learning” 
(data reduction) 


(decision) 


“odd-function” error 


adjustment of system 


Correspondence 


The word “learning” is used in a general 
meaning of deriving one form of information 
from another by a given set of rules. The 
sense in which it will be used corresponds 
with the intuitive notions: that more than 
one observation is necessary; that observa- 
tions at different time instants have to be 
related or averaged (not an instantaneous 
process). As the simplest engineering exam- 
ples the following can be considered: squar- 
ing and averaging over time interval for 
rms error determination; multiplication of 
two signals and averaging over time interval 
for cross-correlation application. 

Because we must work with signal char- 
acteristics instead of instantaneous values 
and we must combine observations made at 
different times, it is clear 1) that the process 
of learning requires time; 2) that the fre- 
quency spectrum of the knowledge resulting 
from the learning is narrower than that of 
the original signal(s). Therefore it is postu- 
lated that the time function of the differ- 
ential equation coefficients in an engineering 
sense can be treated as if there were no con- 
nection of this time function with each of 
the instantaneous signal values. By this as- 
sumption the strictly-mathematically-speak- 
ing nonlinear system can be treated as a 
more tractable vari-linear system. In all well- 
known nonlinear systems the actual in- 
stantaneous values are used for the control 
action, so a clear distinction can be made 
between the intentionally-nonlinear and 
“even-function” (error) systems. 


“ADAPTIVE” AND “OPTIMALIZING” 


A distinction between these types of sys- 
tems can be found by regarding the input of 
external information to a system: 


System Input 


1) Regulator Constant value 


Predetermined vari- 
able values 


2) Program-controlled 


Non-predetermined 
variable values 


3) Servo 


4) Implicit computer 


No external informa- 
tion 


5) “Optimalizing plants” 


In cases 1-4 we shall use the expression 
“adaptive” systems, if they satisfy the re- 
marks with respect to an “even-function” 
error. In many cases there exists already a 
primary feedback loop; the adaptation of the 
system is done by a secondary feedback 
loop (Fig. 4). In case 5 we shall use “optimal- 
izing” if the system satisfies the definition 
given above (Fig. 5). 

In cases 1-4, the “conservation” of the 
amount of information while processing it 
to a higher power level or by the nonlinear- 
ity is the primary goal; the adaptation tries to 
make the best of this information processing 
by changes in the primary, already existing, 
feedback loop. In 5) there is no primary 
(over-all) feedback loop; optimalization in- 
troduces such a loop. The only information 
input was during the development of the 
system, 7.e., the knowledge that there exists 
an extremum in the process operation and in 
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Fig. 4—Application of adaptive control. (a) Primary 
feedback loop. (b) Primary and secondary feed- 
back loop: adaptive system. 
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Fig. 5—Application of optimalizing control. 
No primary feedback loop. 
feedback loop. 


(a) 
(b) Optimalizing 


what operating region. The optimalization 
tries to make the best of the profit, energy, 
quality, or other commodity or economic value. 

Of course, the way of separation of sys- 
tem and environment is important in this 
respect. There may be primary (information 
carrying) feedback loops inside the plant, 
while the complete system may be an op- 
timalizing one. 

In recapitulation, the central ideas are: 
the process of learning; the optimum be- 
havior with respect to: 1) information proc- 
essing in adaptive systems, and 2) energy, 
profit or other economic value or commodity 
in optimalizing systems. 


PURPOSES 


The purposes of the new types of con- 
trol are to give improvements, compared to 
ordinary feedback control or systems with- 
out feedback, in the sense of 1) counteract- 
ing the unpredictable changes in the system; 
2) changing the system with regard to en- 
vironmental conditions and with regard to 
variation of the class of input function, etc.; 
3) compensating partly for component fail- 
ure. 

According to what quantity of the com- 
bination system-++environment is used for 
the “learning process” we distinguish: 


Adaptive (Information Processing Systems) 


a) Input-Character (Change) Sensing 
e.g., signal power to noise power level 
signal spectrum to noise spec- 
trum character 
steady state or transient condi- 
tion 
_ probability of amplitude levels. 
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b) Load Disturbance-Character (Change) 
Sensing 
e.g., signal power to noise power level 
signal spectrum to noise spec- 
trum character 
steady state or transient condi- 
tion 
probability of amplitude levels. 

c) Plant Parameter (Change) Sensing 
e.g., randomly varying parameters 

degree of stability. 

d) Plant State (Change) Sensing 
é.g., energy storage, by which the dy- 

namic behavior of the system 
is tied to history. 

e) Performance Criterion Sensing (In- 
formation Processing of the Primary 
Feedback Loop) 

e.g., different error functions 
S/N level input to S/N level out- 
put. 


The input-character and the load dis- 
turbance-character sensing types are feed 
forward systems; as soon as we monitor the 
output to study the effect of the adaptive 
changes we are using a performance criteri- 
on. As it is the case in all feed forward 
schemes, a thorough a priori knowledge of 
the system behavior is required. c), d), and 
e) are feedback systems. 


Optimalizing (Economic Values, Commodity 
Processing Systems) 


a) Environment Sensing 
b) Process Extremum Sensing 
e.g., production rate 
purity of chemicals 
calculated profit 
actiradius (in transportation). 


Here the environment sensing type is a 
feed forward system, the other a feedback 
arrangement. 


SCHEMATIC SURVEY OF CONTROL SYSTEMS 


The ideas developed in the foregoing 
give rise to the survey of Figs. 6 and 7. Adap- 
tive systems are twice mentioned in these 
schemes due to the two feedback loops in- 
volved in these systems. 


CONCLUDING REMARKS 


The foregoing is a first attempt along a 
different line to get a fundamental idea 
about adaptive and optimalizing control 
systems. Of course it is neither complete nor 
free from defects. 

The central points, however, seem to 
form a basis for discussion: 


The need for some process of “learning” 
due to the “even-function” error or the 
dealing with signal characteristics in- 
stead of instantaneous values; 

The distinction in adaptive and op- 
timalizing systems according to the op- 
timum sought for is in information proc- 
essing or economic-commodity process- 
ing. 


The definition proposed excludes the dif- 
ferent types of pure nonlinear systems in 
which only instantaneous information with- 
out “learning” is used. Some of these sys- 
tems are referred to as “passive adaptive.”! 
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"LEARNING" ASPECTS 


WITHOUT "LEARNING" 
INPUT CHARACTER 


SENSING 
ADAPTIVE 
FEED FORWARD 
LOAD DISTURBANCE 
CHARACTER SENSING 
WITH "LEARNING" 
OPTIMALIZING — ENVIRONMENT SENSING 
CONTROL 
SYSTEMS 
WITHOUT "LEARNING" 
“ODD - FUNCTION" ERROR 
SEE FIGURE 7 
| PLANT PARAMETER 
FEEDBACK ADAPTIVE PLANT STATE 
WITH "LEARNING" PERFORMANCE CRITER. 
EVEN - FUNCTION" 
ERROR 
aNerancaine PROCESS EXTREMUM 
SENSING 
Fig. 6—Survey of control systems. 
MATHEMATICAL CONTROL TYPE. OF CIRCUIT 
INFORMATION ASPECTS SIGNAL (WITH OR WITHOUT TIME DELAY) 
___ ORDINARY 
CIRCUITS 
cowTiNdcds = 
LINEAR 
-— CONSTANT 
COEFF. 
DISCONTINUOUS POSICAST 
L INTENTIONALLY 
LINEAR NONLIN. DAMPING 
INTENTIONALLY 
CONTINUOUS ——— S/N 
ous NONLINEAR SEPARATION 
ADDIT. FORCING 
NONLINEAR FUNCTION 
COMPUTER 
t— NONLINEAR 
RELAY 
CONTINUOUS 
~ DISCONTINUOUS MULTI-POSITION CONTACTOR 
PREDICTION 
RACE - BRAKE 
BANG - BANG 
— VARI - LINEAR —— CONTIN. ADAPTIVE SYSTEM 
(TIME VARYING (CHANGES GOVERNED BY 
‘ PARAMETER SENSING ELEMENT VIA 
opp SYSTEM) “LEARNING") 
FUNCTION". 
ERROR 


RANDOM ELEMENT SYSTEM 
(RANDOM CHANGES) 


VARI - NONLINEAR 


CARRIER SYSTEM 


LINEAR SAMPLED DATA 


DISCONTINUOUS 
(PULSE HEIGHT MODULATED) 


NONLINEAR SAMPLED DATA 
(PULSE WIDTH MODULATED) 


Fig. 7—Survey of control systems with “odd-function” er1o 
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Should these be included then there is no 
reason for not including all nonlinear sys- 
tems which give better response than linear 
systems. 

The definition excludes also the interest- 
ing approach of Lang and Ham called “con- 
ditional feedback.”® There feedback acts 
solely to reduce the influence of disturbances 
and thus determines the response of the sys- 
tem to external loads and internal parameter 
variations. So it has no more adaptive fea- 
tures than an ordinary feedback system; 
only there is more freedom in the construc- 
tion, because the input/output require- 
ments are taken care of by a model with the 
desired dynamic response. Of course this set- 
up will be adaptive as soon as a parameter 
in the model or in the other part of the sys- 
tem is changed according to the statement 
given above. 

It would be possible to define “levels of 


adaptation.” An example: 
Level 
0 No feedback 
1 Ordinary feedback 
2. Conditional feedback 
3 Active adaptation by parameter changes 
4 Active adaptation by parameter changes, 


with prediction of parameter changes 
from observations 


The definition of active systems we should 
like to restrict to those having the levels 
oe 

The process of “learning” has to be 
studied in detail. The results of this “learn- 
ing” will be values for the characteristics to 
be determined. These have to be expressed 
in terms of probability and accuracy (con- 
taminating noise) and time. In general it 
might be possible to get as much information 
as is desired. However, this requires an ex- 
cessive amount of time. 

This leads to some fundamental ques- 
tions: 

What is the best way to derive informa- 
tion from the system with respect to learning 
and with respect to instrumentation (e.g., 
data storage) ? 

What are the limitations to the speed and 
accuracy of learning with respect to the 
noise? 

What is the relation of the learning proc- 
ess to the a priori knowledge about the sys- 
tem? 

What are the basic limitations of adap- 
tive and optimalizing control action? 

What are the special requirements for a 
system to be suited to adaptation or op- 
timalizing? 

The development of these fascinating 
control concepts will depend on the answers 
to these types of questions. 

PIETER EYKHOFF!” 
Dept. of Elec. Engrg. 
University of California 
Berkeley. 


9 G. Lang and J. M. Ham, “Conditional feedback 


-systems—a new approach to feedback control,” 
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Trans. AIEE, vol. 74, pt. II, pp. 152-161; July, 
1955. r ; 

10 On leave from Technological University, Delft, 
The Netherlands, by an appointment supported by 
the International Cooperation Administration under 


the Visiting Research Scientists Program administered : 


by the U. S. National Academy of Sciences. 
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A Note on Third-Order Linear 
Systems* 


In feedback control system design, it is 
often useful to consider the correlation of the 
response to a step input with the closed-loop 
frequency response or zero-pole configura- 
tion. The usual situation is that certain per- 
tinent time characteristics, such as rise 
time, per cent overshoot, and settling time, 
are predicted from certain characteristics of 
the frequency spectrum or the zero-pole lo- 
cations. The correlations have been estab- 
lised exactly for a second-order system,! and 
are given approximately for high-order sys- 
tems in certain cases.2 The approximations 
generally depend upon the system being es- 
sentially described by a so-called “principal 
pair” of complex poles. If the remaining 
zeros and poles are “sufficiently far” from 
the principal pair, then the correlations 
based upon the second-order system hold 
with reasonable accuracy. Designers differ 
on what “sufficiently far” means, but gen- 
erally if the distance from the origin to the 
principal poles is no greater than 4 to ¢ the 
distance to the nearest of the other poles or 
zeros, the approximations are considered 
valid for design purposes, the aim here is to 
present the result of an analog computer 
study showing the effect on the rise time, per 
cent overshoot, and settling time to a step 
input as a pole on the negative real axis ap- 
proaches the region of the complex plane 
which the principal pair of poles occupy. 

The transfer function analyzed has the 
form 1/(1+2¢s+s?)(1+6s), in which the 
time scale has been normalized, correspond- 
to an undamped natural radian frequency 
wo equal to 1.0 rad/second. Depending upon 
the value of the damping constant ¢, the 
principal pair of poles lie somewhere on the 
unit circuit for ¢<1. The parameter 6 indi- 
cates the ratio of the radial distance of one 
of the complex poles (or the geometric mean 
of the principal poles if ¢>1) to the radial 
distance of the real pole (see Fig. 1). 

One of the design criteria is that the 
product of the rise time 7p (10 per cent to 
90 per cent definition) and the upper half- 
power frequency fz (expressed in cps) is ap- 
proximately equal to 0.35. Fig. 2 shows the 
variation of this product with increasing ¢ 
for several different values of 6. The 5=0 
curve is thus for a second-order system. Note 
that as 6 increases, the product Tprf. gen- 
erally becomes somewhat smaller for reason- 
ably high values of ¢. For very low ¢, the 
product is very sensitive to ¢, particularly 
for large values of 6. 

Fig. 3 shows the variation of per unit 
overshoot with M, (the peak value of the 
frequency response) for various values of 6. 
Note that in the range of M, from about 1.1 
to 1.5, the per unit overshoot agrees approx- 
imately with the second-order system if 6 
does not exceed 0.3. For 6 as large as 0.6, the 
variation is quite large, regardless of the 
value of M,. j 

Fig. 4 shows the variation of settling 


* Received by the PGAC, December 18, 1959. 

1 For example, F, E. Nixon, “Principles of Auto- 
matic Controls,” Prentice-Hall, Inc., Englewood 
Cliffs, N. J.; 1953. 5 : 

2For example, M. E. Clynes, “Simple analytic 
method for linear feedback system dynamics,” Trans. 
AIEE (Applications and Industry), vol. 75, pp. 377- 
383; January, 1956, 
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time (in this case, time to settle to within 

5 per cent of the final value) with ¢ for vari- 

ous values of 6. In the intermediate ranges 

of ¢, the settling time increases by a factor 

ranging from 2 to 3 as the system changes 

from a second-order system where 6=0 toa 
third-order system with 6=1.0. 

PRESTON R. CLEMENT 

Princeton University 

Princeton, N. J. 
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Improved Transient Response in 
Servo Systems with Input 
Modifications* 


An ideal servo system should respond in- 
stantly with no overshoot. But due to its 
finite inertia, any system will require a finite 
time to reach the steady-state value and 
may overshoot the same if the effective 
damping is low (below critical damping). 
Introduction of large damping will eliminate 
the overshoot but the delay in response will 
increase to a large value. Quickest response 
is obtained if the damping coefficient is very 
small. However, a low damping causes large 
overshoots and damped oscillations occur 
for a number of cycles. It was, however, 
shown by Smith,! and also by Tallman and 
Smith,? that if we can modify the input sig- 
nal appropriately it is possible to get a quick 
response with no overshoot. The input was 
split up into several fragments and was ap- 
plied at such time intervals that the sum of 
all transients cancels out after the last ex- 
citation is applied. The same technique of 
input modification as that of Smith has been 
developed in this note with a different ap- 
proach which is believed to be a more rigor- 
ous derivation of this method of control. 

Let us consider a second-order servo 
system with effective mass m, damping co- 
efficient R, and compliance D, to which a 
step input of amplitude a has been applied. 
The differential equation of such a system 
is given by 


d?x(t) dx(t) 
Ori 7, 


+DrQ=a (1) 


where x(t) is the output at time ¢. 
Taking Laplace transform and rearrang- 
ing, we get 


s? + as + do 

X(s) = —————_ 2 

. s[(s + a)? + B?] oh 
where 
IR GOD) 
qQ=— 

m  x(0) 
a; eae 
~ mx(0) 


x’(0) and x(0) being initial velocity and dis- 
placement, respectively. 


R 
a = — = the damping ratio 
2m 
D 
a? + 6? = — = wo? (say) 
m 


(where fo=o/2m is the natural resonant 
frequency of the system); 


* Received by the PGAC, December 30, 1959. 

10. J. M. Smith, “Posicast control of damped os- 
cillatory systems,” Proc. IRE, vol. 45, pp. 1249-1255; 
September, 1957. 

2G. H. Tallman and O. J. M. Smith, “Analog 
study of dead-beat posicast control,” IRE TRANS, ON 
AUTOMATIC CONTROL, no. PGAC-4, pp. 14-21; March, 
1958. 


Taking inverse transform we get 


wo 


, ao 1 
a) = 0) +4 [lat B= wart a)? 
Wo 


+ B?(a1 — 2cx)?}/e-** sin (Bt +) (3) 


where 


Avihne 2 + tan ee . 


y = tan! 
a? — B2 — aya + ao Smeal 5-4 


The above equation shows that the out- 
put will attain its steady-state value 
(ao/wo?)x(0) for large values of ¢, when the 
second term in (3) is negligible. For low 
values of a, it will reach the steady-state 
value quickly but will overshoot the same 
and a number of damped oscillations will 
occur before the output settles to its final 
value (do/wo?)x(0). However, for large 
values of a, 8 becomes imaginary and no 
oscillation (or overshoot) occurs. The out- 
put attains its steady-state value exponen- 
tially at a slow rate. However, if we can 
make the coefficient of the second term in 
(3) equal to zero, the output becomes inde- 
pendent of time and attains the steady-state 
value instantaneously. In order to do that, 
we must have 


a — 2a = 0 and a? — B? — aa + a = 0. 
Now 
Rees (0) eee 4 x’ (0) 


oy = , 
oS a m a x(0) m  x«x(0) 


and is zero if x’(0) =0; 7.e., the initial veloc- 
ity is zero. Also, 
a? — B2 — aya + ao 


Rive. RU eRe RO) a 


4m m 4m? 2m? m x(0) mx(0) 
and putting x’(0) =0, we get 
a D 
mx(0) mm 
or 
a 
1(0) = (4) 


Hence if the system has an initial dis- 
placement x(0)=a/d and a zero initial 
velocity, then we can have the output re- 
sponse attain its steady-state value instan- 
taneously and with no overshoot. 

In order that the system may have an 
initial velocity x(0), we have to excite the 
system with another input applied before- 
hand. Assuming that the required step input 
for this initial excitation is of amplitude b 
and is applied to the system at rest (i.e., 
having no initial velocity or displacement), 
we get 


: b b/m 
EM) ey ANN Ty 7 eS 
m (= ” ) 
-e™ sin (Bt + y’) (5) 


where x(t’) is the output at a time ¢’ for this 
initial step 6 and 


y’ = tan! we . 
=O 
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We know that in an underdamped sys- 
tem with a step input, the first zero of veloc- 
ity occurs at the peak of the overshoot, for 
which 


Bt+y =7/2. 


Calling this time 7, we have 
T = ———-- (6) 


For an underdamped system with a low 
value of a (of the order of 0.1 or less), we 
have 


y’—~ —7/2 and B = a 


As T<1 for any value of fo>1 and as a 
has already been assumed small, 


oe! = al: 


2 
~ 
& 


of 


(b) 


Fig. 1—(a) Modified step input for getting improved 
response in a system with fo =10 cps and having a 
low value of effective damping coefficient. (b) 
Output response of the given system with a modi- 
fied step input as shown in (a). 
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Therefore, in order to have a displace- 
ment x(0) with zero velocity, we have, from 


(S), 
b 
(0) = GD) = a (2 —aT)~ 


S|S 


for all practical purposes. 
But from (4) we must have 


a )) = 


1.e., the initial step should be half the ampli- 
tude of the original step a and should pre- 
cede it by a time interval T. 

Thus the input step signal has to be 
modified into a two-step staircase signal as 
shown in Fig. 1(a), with a delay of 1/2f 
between the two steps. It is evidently the 
same type of input modificaion as was de- 
veloped by Smith from a slightly different 
approach and was named by him as “Posi- 
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cast control.”! The above method of analysis 
may also be extended to the three-step (first 
positive, then negative, and then again a 
positive step) input modification of Smith 
to get a quicker output response. 

Fig. 1(a) and 1(b) show the modified in- 
put signal and the corresponding output re- 
sponse for an underdamped system (with 
a=0.1), having fo=10 cps. The immense 
improvement in output response is evident 
from Fig. 1(b), which shows a very sharp 
response with no overshoot. The output 
reaches its steady-state value as soon as the 
second step is applied and the total time de- 
lay between the application of the input 
signal (the first step) and the steady value of 
output response is only 1/2fo. (A much 
smaller time delay between the application 
of the first step and the steady-state output 
response is possible with a three-step input 
modification as discussed by Smith! in his 
pioneering work.) 

The input modification is independent 
of the damping coefficient (a) for all prac- 
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tical purposes, provided @ is small. But this 
is not a serious problem, as the effective 
damping coefficient of any system can be 
made small by applying a suitable amount 
of positive feedback. The input modification 
depends only on the natural resonant fre- 
quency (fo) of the system, which can be de- 
termined easily. 

Thus, for a given system or for a number 
of systems having the same natural resonant 
frequency, the above type of input modifica- 
tion offers a good technique of getting an 
improved system response. The only disad- 
vantage of the above arrangement is that 
the input signal has to be remodified for 
systems having different resonant frequen- 
cies. 

Input modification based on a similar 
analytical approach may as well be used 
profitably for other types of input signals. 

B. CHATTERJEE 
Elec. Engrg. Dept. 
University of Illinois 
Urbana 
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Aircraft Corporation, Sunnyvale, Calif., he 
has worked on design and analysis of servo 
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control and guidance systems. This has in- 
cluded directing design analysis of a re-entry 
body attitude control system and the devel- 
opment of a servo-controlled 100 per cent 
variable thrust liquid rocket engine in con- 
junction with Naval Ordnance Testing Sta- 
tion at China Lake, Calif. He has worked in 
the field of human engineering on the ana- 
lytic design and testing of control systems 
incorporating human operators. 

Mr. Rodden is a member of Tau Beta Pi, 
Pi Tau Sigma, and Sigma Xi. 
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is now a candidate 
for the Doctorate de- 
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12, 1929, in Hutchinson, Kans. He received 
the B.A. degree in 1953 from the University 


of Denver with an area major in the hu- 
manities and an emphasis on philosophy. 
After serving two years with the Army, 
1953-1955, he re- 
ceived the M.S. de- 
gree in library science 
from the University 
of Denver in 1956. 
He then became se- 
rials librarian at the 
Long Beach State 
College Library, Long 
Beach, Calif, acting 
in this capacity from 
1956-1958. He joined 
the System Develop- 
ment Corporation, 
Santa Monica, Calif., in 1958, where he is 
presently reference librarian. 

Mr. Simmons has done_ bibliographic 
searches on Soviet aircraft and missiles, 
mechanical translation, computers in psy- 
chology, Soviet computers, tracking, and 
computers in medicine, in connection with 
SDC projects on air defense systems and 
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Rangasami Sridhar was born in Banga- 
lore, India, on April 10, 1935. He received 
the B.E. degree in mechanical engineering 
in 1955, and the B.E. 
degree in electrical 
engineering in 1956, 
both from the Uni- 
versity of Mysore, 
India. He received 
the M.S. degree in 
mechanical engineer- 
ing in 1957 and the 
Ph.D, degree in Jan- 
uary, 1960, both 
from Purdue Univer- 
sity, Lafayette, Ind. 
His work for the doc- 
toral dissertation was concerned with signal 
stabilization of nonlinear feedback systems 
using external random inputs. 

He is currently an assistant professor of 
electrical engineering at Purdue University. 
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Tau Beta Pi, Sigma Xi, and the Society for 
Experimental Stress Analysis. 
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The IRE Professional Group on Automatic Control is grateful for the 
assistance given by the firms listed below, and invites application for In- 
stitutional Listings from other firms interested in the field of Automatic 
Control. 


HUGHES AIRCRAFT CO., Florence and Teale Sts., Culver City, Calif. 


Res., Dev., Mfg., Radar, Space and Commercial Control Systems, Guided Missiles, Solid State Devices 


RAMO-WOOLDRIDGE, a Division of Thompson Ramo Wooldridge, Inc., 8433 Fallbrook Ave., 
Canoga Park, Calif. 


Research and Development 


The charge for an Institutional Listing is $75.00 per issue or $125.00 for two 
consecutive issues. Applications for Institutional Listings and checks (made 
out to the Institute of Radio Engineers, Inc.) should be sent to Mr. L. G. 
Cumming, Technical Secretary, Institute of Radio Engineers, Inc., 1 East 
79th Street, New York 21, N. Y. 


